Oct 30 10:46:13 user nova-compute[74278]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74278) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74278) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74278) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 30 10:46:13 user nova-compute[74278]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:46:13 user nova-compute[74278]: INFO nova.virt.driver [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 30 10:46:13 user nova-compute[74278]: INFO nova.compute.provider_config [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] Acquiring lock "singleton_lock" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] Acquired lock "singleton_lock" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] Releasing lock "singleton_lock" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] Full set of CONF: {{(pid=74278) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ******************************************************************************** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] Configuration options gathered from: {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ================================================================================ {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] allow_resize_to_same_host      = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] arq_binding_timeout            = 300 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] backdoor_port                  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] backdoor_socket                = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] block_device_allocate_retries  = 300 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] block_device_allocate_retries_interval = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cert                           = self.pem {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute_monitors               = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] config_dir                     = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] config_drive_format            = iso9660 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] config_source                  = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] console_host                   = user {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] control_exchange               = nova {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cpu_allocation_ratio           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] daemon                         = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] debug                          = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] default_access_ip_network_name = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] default_availability_zone      = nova {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] default_ephemeral_format       = ext4 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] default_green_pool_size        = 1000 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] default_schedule_zone          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] disk_allocation_ratio          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] enable_new_services            = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] enabled_ssl_apis               = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] flat_injected                  = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] force_config_drive             = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] force_raw_images               = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] graceful_shutdown_timeout      = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] heal_instance_info_cache_interval = 60 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] host                           = user {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] instance_build_timeout         = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] instance_delete_interval       = 300 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] instance_name_template         = instance-%08x {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] instance_usage_audit           = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] instance_usage_audit_period    = month {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] internal_service_availability_zone = internal {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] key                            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] live_migration_retry_count     = 30 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] log_config_append              = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] log_dir                        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] log_file                       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] log_options                    = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] log_rotate_interval            = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] log_rotate_interval_type       = days {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] log_rotation_type              = none {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] long_rpc_timeout               = 1800 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] max_concurrent_builds          = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] max_concurrent_live_migrations = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] max_concurrent_snapshots       = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] max_local_block_devices        = 3 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] max_logfile_count              = 30 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] max_logfile_size_mb            = 200 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] maximum_instance_delete_attempts = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] metadata_listen                = 0.0.0.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] metadata_listen_port           = 8775 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] metadata_workers               = 3 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] migrate_max_retries            = -1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] mkisofs_cmd                    = genisoimage {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] my_ip                          = 10.0.0.210 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] network_allocate_retries       = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] osapi_compute_listen_port      = 8774 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] osapi_compute_unique_server_name_scope =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] osapi_compute_workers          = 3 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] password_length                = 12 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] periodic_enable                = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] periodic_fuzzy_delay           = 60 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] pointer_model                  = ps2mouse {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] preallocate_images             = none {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] publish_errors                 = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] pybasedir                      = /opt/stack/nova {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ram_allocation_ratio           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] rate_limit_burst               = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] rate_limit_except_level        = CRITICAL {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] rate_limit_interval            = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] reboot_timeout                 = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] reclaim_instance_interval      = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] record                         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] reimage_timeout_per_gb         = 60 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] report_interval                = 120 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] rescue_timeout                 = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] reserved_host_cpus             = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] reserved_host_disk_mb          = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] reserved_host_memory_mb        = 512 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] reserved_huge_pages            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] resize_confirm_window          = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] resize_fs_using_block_device   = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] resume_guests_state_on_host_boot = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] rpc_response_timeout           = 60 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] run_external_periodic_tasks    = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] running_deleted_instance_action = reap {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] running_deleted_instance_timeout = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] scheduler_instance_sync_interval = 120 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] service_down_time              = 720 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] servicegroup_driver            = db {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] shelved_offload_time           = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] shelved_poll_interval          = 3600 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] shutdown_timeout               = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] source_is_ipv6                 = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ssl_only                       = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] state_path                     = /opt/stack/data/nova {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] sync_power_state_interval      = 600 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] sync_power_state_pool_size     = 1000 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] syslog_log_facility            = LOG_USER {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] tempdir                        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] timeout_nbd                    = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] transport_url                  = **** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] update_resources_interval      = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] use_cow_images                 = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] use_eventlog                   = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] use_journal                    = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] use_json                       = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] use_rootwrap_daemon            = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] use_stderr                     = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] use_syslog                     = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vcpu_pin_set                   = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plugging_is_fatal          = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plugging_timeout           = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] virt_mkfs                      = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] volume_usage_poll_interval     = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] watch_log_file                 = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] web                            = /usr/share/spice-html5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_concurrency.disable_process_locking = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.auth_strategy              = keystone {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.compute_link_prefix        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.dhcp_domain                = novalocal {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.enable_instance_password   = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.glance_link_prefix         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.instance_list_per_project_cells = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.list_records_by_skipping_down_cells = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.local_metadata_per_cell    = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.max_limit                  = 1000 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.metadata_cache_expiration  = 15 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.neutron_default_tenant_id  = default {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.use_forwarded_for          = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.use_neutron_default_nets   = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.vendordata_dynamic_targets = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.vendordata_jsonfile_path   = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.backend_argument         = **** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.config_prefix            = cache.oslo {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.dead_timeout             = 60.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.debug_cache_backend      = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.enable_retry_client      = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.enable_socket_keepalive  = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.enabled                  = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.expiration_time          = 600 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.hashclient_retry_attempts = 2 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.memcache_dead_retry      = 300 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.memcache_password        =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.memcache_sasl_enabled    = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.memcache_username        =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.proxies                  = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.retry_attempts           = 2 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.retry_delay              = 0.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.socket_keepalive_count   = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.socket_keepalive_idle    = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.socket_keepalive_interval = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.tls_allowed_ciphers      = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.tls_cafile               = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.tls_certfile             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.tls_enabled              = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cache.tls_keyfile              = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.auth_section            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.auth_type               = password {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.cafile                  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.certfile                = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.collect_timing          = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.cross_az_attach         = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.debug                   = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.endpoint_template       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.http_retries            = 3 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.insecure                = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.keyfile                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.os_region_name          = RegionOne {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.split_loggers           = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cinder.timeout                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute.cpu_dedicated_set      = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute.cpu_shared_set         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute.image_type_exclude_list = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute.resource_provider_association_refresh = 300 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute.shutdown_retry_interval = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] conductor.workers              = 3 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] console.allowed_origins        = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] console.ssl_ciphers            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] console.ssl_minimum_version    = default {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] consoleauth.token_ttl          = 600 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.cafile                  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.certfile                = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.collect_timing          = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.connect_retries         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.connect_retry_delay     = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.endpoint_override       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.insecure                = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.keyfile                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.max_version             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.min_version             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.region_name             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.service_name            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.service_type            = accelerator {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.split_loggers           = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.status_code_retries     = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.status_code_retry_delay = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.timeout                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] cyborg.version                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.backend               = sqlalchemy {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.connection            = **** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.connection_debug      = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.connection_parameters =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.connection_recycle_time = 3600 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.connection_trace      = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.db_inc_retry_interval = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.db_max_retries        = 20 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.db_max_retry_interval = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.db_retry_interval     = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.max_overflow          = 50 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.max_pool_size         = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.max_retries           = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.mysql_wsrep_sync_wait = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.pool_timeout          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.retry_interval        = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.slave_connection      = **** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] database.sqlite_synchronous    = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.backend           = sqlalchemy {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.connection        = **** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.connection_debug  = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.connection_parameters =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.connection_recycle_time = 3600 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.connection_trace  = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.db_inc_retry_interval = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.db_max_retries    = 20 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.db_max_retry_interval = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.db_retry_interval = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.max_overflow      = 50 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.max_pool_size     = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.max_retries       = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.pool_timeout      = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.retry_interval    = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.slave_connection  = **** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] api_database.sqlite_synchronous = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] devices.enabled_mdev_types     = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ephemeral_storage_encryption.enabled = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.api_servers             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.cafile                  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.certfile                = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.collect_timing          = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.connect_retries         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.connect_retry_delay     = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.debug                   = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.default_trusted_certificate_ids = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.enable_certificate_validation = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.enable_rbd_download     = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.endpoint_override       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.insecure                = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.keyfile                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.max_version             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.min_version             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.num_retries             = 3 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.rbd_ceph_conf           =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.rbd_connect_timeout     = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.rbd_pool                =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.rbd_user                =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.region_name             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.service_name            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.service_type            = image {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.split_loggers           = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.status_code_retries     = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.status_code_retry_delay = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.timeout                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.verify_glance_signatures = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] glance.version                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] guestfs.debug                  = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.config_drive_cdrom      = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.config_drive_inject_password = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.enable_remotefx         = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.instances_path_share    =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.limit_cpu_features      = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.use_multipath_io        = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.vswitch_name            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] mks.enabled                    = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] image_cache.manager_interval   = 2400 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] image_cache.precache_concurrency = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] image_cache.remove_unused_base_images = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] image_cache.subdirectory_name  = _base {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.api_max_retries         = 60 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.api_retry_interval      = 2 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.auth_section            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.auth_type               = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.cafile                  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.certfile                = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.collect_timing          = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.conductor_group         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.connect_retries         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.connect_retry_delay     = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.endpoint_override       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.insecure                = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.keyfile                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.max_version             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.min_version             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.peer_list               = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.region_name             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.serial_console_state_timeout = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.service_name            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.service_type            = baremetal {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.split_loggers           = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.status_code_retries     = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.status_code_retry_delay = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.timeout                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ironic.version                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] key_manager.fixed_key          = **** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.barbican_api_version  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.barbican_endpoint     = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.barbican_endpoint_type = public {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.barbican_region_name  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.cafile                = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.certfile              = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.collect_timing        = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.insecure              = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.keyfile               = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.number_of_retries     = 60 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.retry_delay           = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.send_service_user_token = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.split_loggers         = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.timeout               = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.verify_ssl            = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican.verify_ssl_path       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican_service_user.auth_section = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican_service_user.auth_type = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican_service_user.cafile   = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican_service_user.certfile = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican_service_user.collect_timing = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican_service_user.insecure = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican_service_user.keyfile  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican_service_user.split_loggers = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] barbican_service_user.timeout  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.approle_role_id          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.approle_secret_id        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.cafile                   = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.certfile                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.collect_timing           = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.insecure                 = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.keyfile                  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.kv_mountpoint            = secret {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.kv_path                  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.kv_version               = 2 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.namespace                = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.root_token_id            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.split_loggers            = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.ssl_ca_crt_file          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.timeout                  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.use_ssl                  = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.auth_section          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.auth_type             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.cafile                = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.certfile              = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.collect_timing        = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.connect_retries       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.connect_retry_delay   = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.endpoint_override     = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.insecure              = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.keyfile               = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.max_version           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.min_version           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.region_name           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.service_name          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.service_type          = identity {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.split_loggers         = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.status_code_retries   = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.status_code_retry_delay = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.timeout               = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] keystone.version               = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.connection_uri         =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.cpu_mode               = custom {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: WARNING oslo_config.cfg [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.cpu_power_governor_high = performance {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.cpu_power_management   = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.device_detach_attempts = 8 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.device_detach_timeout  = 20 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.disk_cachemodes        = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.disk_prefix            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.enabled_perf_events    = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.file_backed_memory     = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.gid_maps               = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.hw_disk_discard        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.hw_machine_type        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.images_rbd_pool        = rbd {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.images_type            = default {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.images_volume_group    = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.inject_key             = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.inject_partition       = -2 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.inject_password        = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.iscsi_iface            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.iser_use_multipath     = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_downtime = 500 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_inbound_addr = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_scheme  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_timeout_action = abort {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_tunnelled = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: WARNING oslo_config.cfg [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 30 10:46:13 user nova-compute[74278]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 30 10:46:13 user nova-compute[74278]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 30 10:46:13 user nova-compute[74278]: and ``live_migration_inbound_addr`` respectively.
Oct 30 10:46:13 user nova-compute[74278]: ).  Its value may be silently ignored in the future.
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.live_migration_with_native_tls = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.max_queues             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.nfs_mount_options      = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.num_pcie_ports         = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.pmem_namespaces        = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.quobyte_client_cfg     = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.rbd_secret_uuid        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.rbd_user               = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.rescue_image_id        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.rescue_kernel_id       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.rx_queue_size          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.smbfs_mount_options    =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.snapshot_compression   = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.snapshot_image_format  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.sparse_logical_volumes = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.swtpm_enabled          = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.swtpm_group            = tss {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.swtpm_user             = tss {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.sysinfo_serial         = unique {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.tb_cache_size          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.tx_queue_size          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.uid_maps               = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.use_virtio_for_bridges = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.virt_type              = kvm {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.volume_clear           = zero {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.volume_clear_size      = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.volume_use_multipath   = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.vzstorage_cache_path   = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.auth_section           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.auth_type              = password {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.cafile                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.certfile               = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.collect_timing         = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.connect_retries        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.connect_retry_delay    = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.default_floating_pool  = public {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.endpoint_override      = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.extension_sync_interval = 600 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.http_retries           = 3 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.insecure               = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.keyfile                = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.max_version            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.min_version            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.ovs_bridge             = br-int {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.physnets               = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.region_name            = RegionOne {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.service_metadata_proxy = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.service_name           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.service_type           = network {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.split_loggers          = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.status_code_retries    = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.status_code_retry_delay = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.timeout                = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] neutron.version                = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] notifications.bdms_in_notifications = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] notifications.default_level    = INFO {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] notifications.notification_format = unversioned {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] notifications.notify_on_state_change = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] pci.alias                      = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] pci.device_spec                = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] pci.report_in_placement        = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.auth_section         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.auth_type            = password {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.cafile               = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.certfile             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.collect_timing       = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.connect_retries      = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.connect_retry_delay  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.default_domain_id    = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.default_domain_name  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.domain_id            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.domain_name          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.endpoint_override    = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.insecure             = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.keyfile              = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.max_version          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.min_version          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.password             = **** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.project_domain_id    = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.project_domain_name  = Default {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:13 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.project_id           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.project_name         = service {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.region_name          = RegionOne {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.service_name         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.service_type         = placement {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.split_loggers        = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.status_code_retries  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.status_code_retry_delay = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.system_scope         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.timeout              = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.trust_id             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.user_domain_id       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.user_domain_name     = Default {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.user_id              = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.username             = placement {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] placement.version              = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.cores                    = 20 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.count_usage_from_placement = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.injected_file_content_bytes = 10240 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.injected_file_path_length = 255 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.injected_files           = 5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.instances                = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.key_pairs                = 100 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.metadata_items           = 128 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.ram                      = 51200 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.recheck_quota            = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.server_group_members     = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] quota.server_groups            = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] rdp.enabled                    = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] scheduler.image_metadata_prefilter = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] scheduler.max_attempts         = 3 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] scheduler.max_placement_results = 1000 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] scheduler.workers              = 3 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.host_subset_size = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.isolated_hosts = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.isolated_images = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.pci_in_placement = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.track_instance_changes = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] metrics.required               = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] metrics.weight_multiplier      = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] metrics.weight_setting         = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] serial_console.enabled         = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] serial_console.port_range      = 10000:20000 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] serial_console.serialproxy_port = 6083 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] service_user.auth_section      = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] service_user.auth_type         = password {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] service_user.cafile            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] service_user.certfile          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] service_user.collect_timing    = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] service_user.insecure          = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] service_user.keyfile           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] service_user.send_service_user_token = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] service_user.split_loggers     = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] service_user.timeout           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] spice.agent_enabled            = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] spice.enabled                  = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] spice.html5proxy_port          = 6082 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] spice.image_compression        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] spice.jpeg_compression         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] spice.playback_compression     = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] spice.server_listen            = 127.0.0.1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] spice.streaming_mode           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] spice.zlib_compression         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] upgrade_levels.baseapi         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] upgrade_levels.cert            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] upgrade_levels.compute         = auto {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] upgrade_levels.conductor       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] upgrade_levels.scheduler       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vendordata_dynamic_auth.cafile = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vendordata_dynamic_auth.certfile = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vendordata_dynamic_auth.insecure = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vendordata_dynamic_auth.timeout = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.api_retry_count         = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.ca_file                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.cache_prefix            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.cluster_name            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.connection_pool_size    = 10 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.console_delay_seconds   = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.datastore_regex         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.host_ip                 = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.host_password           = **** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.host_port               = 443 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.host_username           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.insecure                = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.integration_bridge      = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.maximum_objects         = 100 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.pbm_default_policy      = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.pbm_enabled             = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.pbm_wsdl_location       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.serial_port_proxy_uri   = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.serial_port_service_uri = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.task_poll_interval      = 0.5 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.use_linked_clone        = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.vnc_keymap              = en-us {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.vnc_port                = 5900 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vmware.vnc_port_total          = 10000 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vnc.auth_schemes               = ['none'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vnc.enabled                    = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vnc.novncproxy_port            = 6080 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vnc.vencrypt_ca_certs          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vnc.vencrypt_client_cert       = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vnc.vencrypt_client_key        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.disable_rootwrap   = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.enable_numa_live_migration = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.libvirt_disable_apic = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] wsgi.client_socket_timeout     = 900 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] wsgi.default_pool_size         = 1000 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] wsgi.keep_alive                = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] wsgi.max_header_line           = 16384 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] wsgi.ssl_ca_file               = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] wsgi.ssl_cert_file             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] wsgi.ssl_key_file              = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] wsgi.tcp_keepidle              = 600 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] zvm.ca_file                    = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] zvm.cloud_connector_url        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] zvm.reachable_timeout          = 300 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_policy.enforce_new_defaults = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_policy.enforce_scope      = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_policy.policy_default_rule = default {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler.connection_string     = messaging:// {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler.enabled               = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler.es_doc_type           = notification {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler.es_scroll_size        = 10000 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler.es_scroll_time        = 2m {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler.filter_error_trace    = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler.hmac_keys             = **** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler.sentinel_service_name = mymaster {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler.socket_timeout        = 0.1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler.trace_requests        = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler.trace_sqlalchemy      = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler_jaeger.process_tags   = {} {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler_jaeger.service_name_prefix = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] profiler_otlp.service_name_prefix = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] remote_debug.host              = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] remote_debug.port              = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_notifications.retry = -1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.auth_section        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.auth_type           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.cafile              = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.certfile            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.collect_timing      = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.connect_retries     = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.connect_retry_delay = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.endpoint_id         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.endpoint_override   = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.insecure            = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.keyfile             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.max_version         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.min_version         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.region_name         = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.service_name        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.service_type        = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.split_loggers       = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.status_code_retries = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.status_code_retry_delay = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.timeout             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.valid_interfaces    = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_limit.version             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_reports.file_event_handler = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] oslo_reports.log_dir           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plug_ovs_privileged.group  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] vif_plug_ovs_privileged.user   = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_ovs.isolate_vif         = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] os_brick.lock_path             = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] privsep_osbrick.capabilities   = [21] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] privsep_osbrick.group          = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] privsep_osbrick.helper_command = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] privsep_osbrick.user           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] nova_sys_admin.group           = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] nova_sys_admin.helper_command  = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] nova_sys_admin.user            = None {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG oslo_service.service [None req-a203bf21-c14d-4573-97a9-4d21041f8c21 None None] ******************************************************************************** {{(pid=74278) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 30 10:46:14 user nova-compute[74278]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 30 10:46:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Connecting to libvirt: qemu:///system {{(pid=74278) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ff6b41ea440> {{(pid=74278) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 30 10:46:14 user nova-compute[74278]: libvirt:  error : internal error: could not initialize domain event timer
Oct 30 10:46:14 user nova-compute[74278]: WARNING nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 30 10:46:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ff6b41ea440> {{(pid=74278) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Starting native event thread {{(pid=74278) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Starting green dispatch thread {{(pid=74278) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 30 10:46:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Starting connection event dispatch thread {{(pid=74278) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 30 10:46:14 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Connection event '1' reason 'None'
Oct 30 10:46:14 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 30 10:46:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.mount [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Initialising _HostMountState generation 0 {{(pid=74278) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 30 10:46:21 user nova-compute[74278]: INFO nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Libvirt host capabilities <capabilities>
Oct 30 10:46:21 user nova-compute[74278]:   <host>
Oct 30 10:46:21 user nova-compute[74278]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 30 10:46:21 user nova-compute[74278]:     <cpu>
Oct 30 10:46:21 user nova-compute[74278]:       <arch>x86_64</arch>
Oct 30 10:46:21 user nova-compute[74278]:       <model>IvyBridge-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <vendor>Intel</vendor>
Oct 30 10:46:21 user nova-compute[74278]:       <microcode version='1070'/>
Oct 30 10:46:21 user nova-compute[74278]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 30 10:46:21 user nova-compute[74278]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='ss'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='vmx'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='pcid'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='osxsave'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='hypervisor'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='arat'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='tsc_adjust'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='md-clear'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='stibp'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='arch-capabilities'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='ssbd'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='invtsc'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='rsba'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature name='skip-l1dfl-vmentry'/>
Oct 30 10:46:21 user nova-compute[74278]:       <pages unit='KiB' size='4'/>
Oct 30 10:46:21 user nova-compute[74278]:       <pages unit='KiB' size='2048'/>
Oct 30 10:46:21 user nova-compute[74278]:     </cpu>
Oct 30 10:46:21 user nova-compute[74278]:     <power_management>
Oct 30 10:46:21 user nova-compute[74278]:       <suspend_mem/>
Oct 30 10:46:21 user nova-compute[74278]:       <suspend_disk/>
Oct 30 10:46:21 user nova-compute[74278]:       <suspend_hybrid/>
Oct 30 10:46:21 user nova-compute[74278]:     </power_management>
Oct 30 10:46:21 user nova-compute[74278]:     <iommu support='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     <migration_features>
Oct 30 10:46:21 user nova-compute[74278]:       <live/>
Oct 30 10:46:21 user nova-compute[74278]:       <uri_transports>
Oct 30 10:46:21 user nova-compute[74278]:         <uri_transport>tcp</uri_transport>
Oct 30 10:46:21 user nova-compute[74278]:         <uri_transport>rdma</uri_transport>
Oct 30 10:46:21 user nova-compute[74278]:       </uri_transports>
Oct 30 10:46:21 user nova-compute[74278]:     </migration_features>
Oct 30 10:46:21 user nova-compute[74278]:     <topology>
Oct 30 10:46:21 user nova-compute[74278]:       <cells num='2'>
Oct 30 10:46:21 user nova-compute[74278]:         <cell id='0'>
Oct 30 10:46:21 user nova-compute[74278]:           <memory unit='KiB'>8140616</memory>
Oct 30 10:46:21 user nova-compute[74278]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 30 10:46:21 user nova-compute[74278]:           <pages unit='KiB' size='2048'>0</pages>
Oct 30 10:46:21 user nova-compute[74278]:           <distances>
Oct 30 10:46:21 user nova-compute[74278]:             <sibling id='0' value='10'/>
Oct 30 10:46:21 user nova-compute[74278]:             <sibling id='1' value='20'/>
Oct 30 10:46:21 user nova-compute[74278]:           </distances>
Oct 30 10:46:21 user nova-compute[74278]:           <cpus num='6'>
Oct 30 10:46:21 user nova-compute[74278]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 30 10:46:21 user nova-compute[74278]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 30 10:46:21 user nova-compute[74278]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 30 10:46:21 user nova-compute[74278]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 30 10:46:21 user nova-compute[74278]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 30 10:46:21 user nova-compute[74278]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 30 10:46:21 user nova-compute[74278]:           </cpus>
Oct 30 10:46:21 user nova-compute[74278]:         </cell>
Oct 30 10:46:21 user nova-compute[74278]:         <cell id='1'>
Oct 30 10:46:21 user nova-compute[74278]:           <memory unit='KiB'>8255068</memory>
Oct 30 10:46:21 user nova-compute[74278]:           <pages unit='KiB' size='4'>2063767</pages>
Oct 30 10:46:21 user nova-compute[74278]:           <pages unit='KiB' size='2048'>0</pages>
Oct 30 10:46:21 user nova-compute[74278]:           <distances>
Oct 30 10:46:21 user nova-compute[74278]:             <sibling id='0' value='20'/>
Oct 30 10:46:21 user nova-compute[74278]:             <sibling id='1' value='10'/>
Oct 30 10:46:21 user nova-compute[74278]:           </distances>
Oct 30 10:46:21 user nova-compute[74278]:           <cpus num='6'>
Oct 30 10:46:21 user nova-compute[74278]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 30 10:46:21 user nova-compute[74278]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 30 10:46:21 user nova-compute[74278]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 30 10:46:21 user nova-compute[74278]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 30 10:46:21 user nova-compute[74278]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 30 10:46:21 user nova-compute[74278]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 30 10:46:21 user nova-compute[74278]:           </cpus>
Oct 30 10:46:21 user nova-compute[74278]:         </cell>
Oct 30 10:46:21 user nova-compute[74278]:       </cells>
Oct 30 10:46:21 user nova-compute[74278]:     </topology>
Oct 30 10:46:21 user nova-compute[74278]:     <cache>
Oct 30 10:46:21 user nova-compute[74278]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 30 10:46:21 user nova-compute[74278]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 30 10:46:21 user nova-compute[74278]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 30 10:46:21 user nova-compute[74278]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 30 10:46:21 user nova-compute[74278]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 30 10:46:21 user nova-compute[74278]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 30 10:46:21 user nova-compute[74278]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 30 10:46:21 user nova-compute[74278]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 30 10:46:21 user nova-compute[74278]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 30 10:46:21 user nova-compute[74278]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 30 10:46:21 user nova-compute[74278]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 30 10:46:21 user nova-compute[74278]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 30 10:46:21 user nova-compute[74278]:     </cache>
Oct 30 10:46:21 user nova-compute[74278]:     <secmodel>
Oct 30 10:46:21 user nova-compute[74278]:       <model>apparmor</model>
Oct 30 10:46:21 user nova-compute[74278]:       <doi>0</doi>
Oct 30 10:46:21 user nova-compute[74278]:     </secmodel>
Oct 30 10:46:21 user nova-compute[74278]:     <secmodel>
Oct 30 10:46:21 user nova-compute[74278]:       <model>dac</model>
Oct 30 10:46:21 user nova-compute[74278]:       <doi>0</doi>
Oct 30 10:46:21 user nova-compute[74278]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 30 10:46:21 user nova-compute[74278]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 30 10:46:21 user nova-compute[74278]:     </secmodel>
Oct 30 10:46:21 user nova-compute[74278]:   </host>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='alpha'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>64</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>clipper</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='armv6l'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>integratorcp</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>borzoi</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>spitz</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>nuri</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>musca-b1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>versatileab</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>kzm</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>musca-a</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>smdkc210</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sx1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>z2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>tosa</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>sabrelite</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>realview-eb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>n810</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>n800</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>versatilepb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>terrier</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mainstone</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>midway</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>musicpal</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>microbit</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>cubieboard</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>verdex</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>netduino2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>raspi2b</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>cheetah</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>highbank</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>akita</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>connex</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>collie</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>raspi0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='armv7l'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>integratorcp</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>borzoi</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>spitz</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>nuri</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>musca-b1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>versatileab</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>kzm</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>musca-a</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>smdkc210</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sx1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>z2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>tosa</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>sabrelite</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>realview-eb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>n810</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>n800</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>versatilepb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>terrier</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mainstone</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>midway</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>musicpal</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>microbit</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>cubieboard</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>verdex</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>netduino2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>raspi2b</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>cheetah</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>highbank</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>akita</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>connex</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>collie</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>raspi0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='aarch64'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>64</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>integratorcp</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>borzoi</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>spitz</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>nuri</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>musca-b1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>versatileab</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>kzm</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>musca-a</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>smdkc210</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sx1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>z2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>tosa</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>sabrelite</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>realview-eb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>n810</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>n800</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>versatilepb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>terrier</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mainstone</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>midway</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>musicpal</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>microbit</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>cubieboard</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>verdex</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>netduino2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>raspi3b</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>raspi2b</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>cheetah</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>highbank</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>akita</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>connex</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>collie</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>raspi0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <acpi default='on' toggle='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='cris'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='i686'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>x-remote</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>isapc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>microvm</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='kvm'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <pae/>
Oct 30 10:46:21 user nova-compute[74278]:       <nonpae/>
Oct 30 10:46:21 user nova-compute[74278]:       <acpi default='on' toggle='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:       <apic default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='m68k'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>an5206</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>q800</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>next-cube</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='microblaze'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='microblazeel'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='mips'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='16'>malta</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mipssim</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='mipsel'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='16'>malta</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mipssim</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='mips64'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>64</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='16'>malta</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mipssim</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>pica61</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>magnum</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='mips64el'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>64</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='16'>malta</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mipssim</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>pica61</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>magnum</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='16'>boston</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='ppc'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>g3beige</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mac99</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>ppce500</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>pegasos2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sam460ex</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>bamboo</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>40p</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>ref405ep</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>taihu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='ppc64'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>64</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2048'>powernv9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>taihu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2048'>powernv10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>ppce500</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>40p</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>pegasos2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>bamboo</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>g3beige</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mac99</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sam460ex</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>ref405ep</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2048'>powernv8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='ppc64le'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>64</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2048'>powernv9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>taihu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2048'>powernv10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>ppce500</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>40p</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>pegasos2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>bamboo</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>g3beige</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>mac99</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sam460ex</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>ref405ep</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2048'>powernv8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='riscv32'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='8'>spike</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>opentitan</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='5'>sifive_u</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sifive_e</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='8'>virt</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='riscv64'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>64</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='8'>spike</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='5'>sifive_u</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>shakti_c</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sifive_e</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='8'>virt</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='s390x'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>64</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='sh4'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>shix</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>r2d</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='sh4eb'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>64</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>shix</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>r2d</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='sparc'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>SS-5</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>SS-20</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>LX</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>SS-4</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>SS-10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>Voyager</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='sparc64'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>64</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sun4u</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>niagara</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>sun4v</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='x86_64'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>64</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>x-remote</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='1'>isapc</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>microvm</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='kvm'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <acpi default='on' toggle='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:       <apic default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='xtensa'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>sim</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>kc705</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>ml605</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>virt</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>lx200</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>lx60</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]:   <guest>
Oct 30 10:46:21 user nova-compute[74278]:     <os_type>hvm</os_type>
Oct 30 10:46:21 user nova-compute[74278]:     <arch name='xtensaeb'>
Oct 30 10:46:21 user nova-compute[74278]:       <wordsize>32</wordsize>
Oct 30 10:46:21 user nova-compute[74278]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='4'>sim</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>kc705</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>ml605</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>virt</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>lx200</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>lx60</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 30 10:46:21 user nova-compute[74278]:       <domain type='qemu'/>
Oct 30 10:46:21 user nova-compute[74278]:     </arch>
Oct 30 10:46:21 user nova-compute[74278]:     <features>
Oct 30 10:46:21 user nova-compute[74278]:       <cpuselection/>
Oct 30 10:46:21 user nova-compute[74278]:       <deviceboot/>
Oct 30 10:46:21 user nova-compute[74278]:       <disksnapshot default='on' toggle='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     </features>
Oct 30 10:46:21 user nova-compute[74278]:   </guest>
Oct 30 10:46:21 user nova-compute[74278]: </capabilities>
Oct 30 10:46:21 user nova-compute[74278]: 
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 30 10:46:21 user nova-compute[74278]: <domainCapabilities>
Oct 30 10:46:21 user nova-compute[74278]:   <path>/usr/bin/qemu-system-i386</path>
Oct 30 10:46:21 user nova-compute[74278]:   <domain>kvm</domain>
Oct 30 10:46:21 user nova-compute[74278]:   <machine>pc-i440fx-jammy</machine>
Oct 30 10:46:21 user nova-compute[74278]:   <arch>i686</arch>
Oct 30 10:46:21 user nova-compute[74278]:   <vcpu max='255'/>
Oct 30 10:46:21 user nova-compute[74278]:   <iothreads supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:   <os supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:     <enum name='firmware'/>
Oct 30 10:46:21 user nova-compute[74278]:     <loader supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>rom</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>pflash</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='readonly'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>yes</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='secure'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </loader>
Oct 30 10:46:21 user nova-compute[74278]:   </os>
Oct 30 10:46:21 user nova-compute[74278]:   <cpu>
Oct 30 10:46:21 user nova-compute[74278]:     <mode name='host-passthrough' supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='hostPassthroughMigratable'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </mode>
Oct 30 10:46:21 user nova-compute[74278]:     <mode name='maximum' supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='maximumMigratable'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>on</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </mode>
Oct 30 10:46:21 user nova-compute[74278]:     <mode name='host-model' supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <vendor>Intel</vendor>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='ss'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='vmx'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='pcid'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='hypervisor'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='arat'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='umip'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='md-clear'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='stibp'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='ssbd'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='ibpb'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='ibrs'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='amd-stibp'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='disable' name='erms'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='disable' name='lm'/>
Oct 30 10:46:21 user nova-compute[74278]:     </mode>
Oct 30 10:46:21 user nova-compute[74278]:     <mode name='custom' supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>qemu64</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>qemu32</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>phenom</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>pentium3</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>pentium2</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>pentium</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>n270</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>kvm64</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>kvm32</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>coreduo</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>core2duo</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>athlon</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Westmere-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Westmere</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Snowridge</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Server</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Client</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>SandyBridge</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Penryn</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G5</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G4</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G3</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G2</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G1</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Nehalem-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Nehalem</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>IvyBridge</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Icelake-Server</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Haswell</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>EPYC-Rome</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>EPYC-Milan</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>EPYC</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Dhyana</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Cooperlake</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Conroe</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Broadwell</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>486</model>
Oct 30 10:46:21 user nova-compute[74278]:     </mode>
Oct 30 10:46:21 user nova-compute[74278]:   </cpu>
Oct 30 10:46:21 user nova-compute[74278]:   <memoryBacking supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:     <enum name='sourceType'>
Oct 30 10:46:21 user nova-compute[74278]:       <value>file</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>anonymous</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>memfd</value>
Oct 30 10:46:21 user nova-compute[74278]:     </enum>
Oct 30 10:46:21 user nova-compute[74278]:   </memoryBacking>
Oct 30 10:46:21 user nova-compute[74278]:   <devices>
Oct 30 10:46:21 user nova-compute[74278]:     <disk supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='diskDevice'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>disk</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>cdrom</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>floppy</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>lun</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='bus'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>ide</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>fdc</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>sata</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </disk>
Oct 30 10:46:21 user nova-compute[74278]:     <graphics supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>sdl</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>vnc</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>spice</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>egl-headless</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </graphics>
Oct 30 10:46:21 user nova-compute[74278]:     <video supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='modelType'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>vga</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>cirrus</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>vmvga</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>qxl</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>none</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>bochs</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>ramfb</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </video>
Oct 30 10:46:21 user nova-compute[74278]:     <hostdev supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='mode'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>subsystem</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='startupPolicy'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>default</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>mandatory</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>requisite</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>optional</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='subsysType'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>pci</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='capsType'/>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='pciBackend'/>
Oct 30 10:46:21 user nova-compute[74278]:     </hostdev>
Oct 30 10:46:21 user nova-compute[74278]:     <rng supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>random</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>egd</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>builtin</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </rng>
Oct 30 10:46:21 user nova-compute[74278]:     <filesystem supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='driverType'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>path</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>handle</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtiofs</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </filesystem>
Oct 30 10:46:21 user nova-compute[74278]:     <tpm supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>tpm-tis</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>tpm-crb</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>passthrough</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>emulator</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </tpm>
Oct 30 10:46:21 user nova-compute[74278]:   </devices>
Oct 30 10:46:21 user nova-compute[74278]:   <features>
Oct 30 10:46:21 user nova-compute[74278]:     <gic supported='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     <vmcoreinfo supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:     <genid supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:     <backingStoreInput supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:     <backup supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:     <sev supported='no'/>
Oct 30 10:46:21 user nova-compute[74278]:   </features>
Oct 30 10:46:21 user nova-compute[74278]: </domainCapabilities>
Oct 30 10:46:21 user nova-compute[74278]:  {{(pid=74278) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 30 10:46:21 user nova-compute[74278]: <domainCapabilities>
Oct 30 10:46:21 user nova-compute[74278]:   <path>/usr/bin/qemu-system-i386</path>
Oct 30 10:46:21 user nova-compute[74278]:   <domain>kvm</domain>
Oct 30 10:46:21 user nova-compute[74278]:   <machine>pc-q35-jammy</machine>
Oct 30 10:46:21 user nova-compute[74278]:   <arch>i686</arch>
Oct 30 10:46:21 user nova-compute[74278]:   <vcpu max='288'/>
Oct 30 10:46:21 user nova-compute[74278]:   <iothreads supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:   <os supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:     <enum name='firmware'/>
Oct 30 10:46:21 user nova-compute[74278]:     <loader supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>rom</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>pflash</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='readonly'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>yes</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='secure'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </loader>
Oct 30 10:46:21 user nova-compute[74278]:   </os>
Oct 30 10:46:21 user nova-compute[74278]:   <cpu>
Oct 30 10:46:21 user nova-compute[74278]:     <mode name='host-passthrough' supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='hostPassthroughMigratable'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </mode>
Oct 30 10:46:21 user nova-compute[74278]:     <mode name='maximum' supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='maximumMigratable'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>on</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </mode>
Oct 30 10:46:21 user nova-compute[74278]:     <mode name='host-model' supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <vendor>Intel</vendor>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='ss'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='vmx'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='pcid'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='hypervisor'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='arat'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='umip'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='md-clear'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='stibp'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='ssbd'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='ibpb'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='ibrs'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='amd-stibp'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='disable' name='erms'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='disable' name='lm'/>
Oct 30 10:46:21 user nova-compute[74278]:     </mode>
Oct 30 10:46:21 user nova-compute[74278]:     <mode name='custom' supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>qemu64</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>qemu32</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>phenom</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>pentium3</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>pentium2</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>pentium</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>n270</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>kvm64</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>kvm32</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>coreduo</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>core2duo</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>athlon</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Westmere-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Westmere</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Snowridge</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Server</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Client</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>SandyBridge</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Penryn</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G5</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G4</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G3</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G2</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G1</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Nehalem-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Nehalem</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>IvyBridge</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Icelake-Server</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Haswell</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>EPYC-Rome</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>EPYC-Milan</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>EPYC</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Dhyana</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Cooperlake</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Conroe</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Broadwell</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>486</model>
Oct 30 10:46:21 user nova-compute[74278]:     </mode>
Oct 30 10:46:21 user nova-compute[74278]:   </cpu>
Oct 30 10:46:21 user nova-compute[74278]:   <memoryBacking supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:     <enum name='sourceType'>
Oct 30 10:46:21 user nova-compute[74278]:       <value>file</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>anonymous</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>memfd</value>
Oct 30 10:46:21 user nova-compute[74278]:     </enum>
Oct 30 10:46:21 user nova-compute[74278]:   </memoryBacking>
Oct 30 10:46:21 user nova-compute[74278]:   <devices>
Oct 30 10:46:21 user nova-compute[74278]:     <disk supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='diskDevice'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>disk</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>cdrom</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>floppy</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>lun</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='bus'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>fdc</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>sata</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </disk>
Oct 30 10:46:21 user nova-compute[74278]:     <graphics supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>sdl</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>vnc</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>spice</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>egl-headless</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </graphics>
Oct 30 10:46:21 user nova-compute[74278]:     <video supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='modelType'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>vga</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>cirrus</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>vmvga</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>qxl</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>none</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>bochs</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>ramfb</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </video>
Oct 30 10:46:21 user nova-compute[74278]:     <hostdev supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='mode'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>subsystem</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='startupPolicy'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>default</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>mandatory</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>requisite</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>optional</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='subsysType'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>pci</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='capsType'/>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='pciBackend'/>
Oct 30 10:46:21 user nova-compute[74278]:     </hostdev>
Oct 30 10:46:21 user nova-compute[74278]:     <rng supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>random</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>egd</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>builtin</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </rng>
Oct 30 10:46:21 user nova-compute[74278]:     <filesystem supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='driverType'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>path</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>handle</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtiofs</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </filesystem>
Oct 30 10:46:21 user nova-compute[74278]:     <tpm supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>tpm-tis</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>tpm-crb</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>passthrough</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>emulator</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </tpm>
Oct 30 10:46:21 user nova-compute[74278]:   </devices>
Oct 30 10:46:21 user nova-compute[74278]:   <features>
Oct 30 10:46:21 user nova-compute[74278]:     <gic supported='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     <vmcoreinfo supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:     <genid supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:     <backingStoreInput supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:     <backup supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:     <sev supported='no'/>
Oct 30 10:46:21 user nova-compute[74278]:   </features>
Oct 30 10:46:21 user nova-compute[74278]: </domainCapabilities>
Oct 30 10:46:21 user nova-compute[74278]:  {{(pid=74278) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 30 10:46:21 user nova-compute[74278]: <domainCapabilities>
Oct 30 10:46:21 user nova-compute[74278]:   <path>/usr/bin/qemu-system-i386</path>
Oct 30 10:46:21 user nova-compute[74278]:   <domain>kvm</domain>
Oct 30 10:46:21 user nova-compute[74278]:   <machine>pc-i440fx-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:   <arch>i686</arch>
Oct 30 10:46:21 user nova-compute[74278]:   <vcpu max='255'/>
Oct 30 10:46:21 user nova-compute[74278]:   <iothreads supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:   <os supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:     <enum name='firmware'/>
Oct 30 10:46:21 user nova-compute[74278]:     <loader supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>rom</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>pflash</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='readonly'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>yes</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='secure'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </loader>
Oct 30 10:46:21 user nova-compute[74278]:   </os>
Oct 30 10:46:21 user nova-compute[74278]:   <cpu>
Oct 30 10:46:21 user nova-compute[74278]:     <mode name='host-passthrough' supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='hostPassthroughMigratable'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </mode>
Oct 30 10:46:21 user nova-compute[74278]:     <mode name='maximum' supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='maximumMigratable'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>on</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </mode>
Oct 30 10:46:21 user nova-compute[74278]:     <mode name='host-model' supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <vendor>Intel</vendor>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='ss'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='vmx'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='pcid'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='hypervisor'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='arat'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='umip'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='md-clear'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='stibp'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='ssbd'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='ibpb'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='ibrs'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='amd-stibp'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='disable' name='erms'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 10:46:21 user nova-compute[74278]:       <feature policy='disable' name='lm'/>
Oct 30 10:46:21 user nova-compute[74278]:     </mode>
Oct 30 10:46:21 user nova-compute[74278]:     <mode name='custom' supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>qemu64</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>qemu32</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>phenom</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>pentium3</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>pentium2</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>pentium</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>n270</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>kvm64</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>kvm32</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>coreduo</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>core2duo</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>athlon</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Westmere-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Westmere</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Snowridge</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Server</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Skylake-Client</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>SandyBridge</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Penryn</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G5</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G4</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G3</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G2</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Opteron_G1</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Nehalem-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Nehalem</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>IvyBridge</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Icelake-Server</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Haswell</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>EPYC-Rome</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>EPYC-Milan</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>EPYC</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Dhyana</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Cooperlake</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Conroe</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='no'>Broadwell</model>
Oct 30 10:46:21 user nova-compute[74278]:       <model usable='yes'>486</model>
Oct 30 10:46:21 user nova-compute[74278]:     </mode>
Oct 30 10:46:21 user nova-compute[74278]:   </cpu>
Oct 30 10:46:21 user nova-compute[74278]:   <memoryBacking supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:     <enum name='sourceType'>
Oct 30 10:46:21 user nova-compute[74278]:       <value>file</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>anonymous</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>memfd</value>
Oct 30 10:46:21 user nova-compute[74278]:     </enum>
Oct 30 10:46:21 user nova-compute[74278]:   </memoryBacking>
Oct 30 10:46:21 user nova-compute[74278]:   <devices>
Oct 30 10:46:21 user nova-compute[74278]:     <disk supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='diskDevice'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>disk</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>cdrom</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>floppy</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>lun</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='bus'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>ide</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>fdc</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>sata</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </disk>
Oct 30 10:46:21 user nova-compute[74278]:     <graphics supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>sdl</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>vnc</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>spice</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>egl-headless</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </graphics>
Oct 30 10:46:21 user nova-compute[74278]:     <video supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='modelType'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>vga</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>cirrus</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>vmvga</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>qxl</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>none</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>bochs</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>ramfb</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </video>
Oct 30 10:46:21 user nova-compute[74278]:     <hostdev supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='mode'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>subsystem</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='startupPolicy'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>default</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>mandatory</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>requisite</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>optional</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='subsysType'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>pci</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='capsType'/>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='pciBackend'/>
Oct 30 10:46:21 user nova-compute[74278]:     </hostdev>
Oct 30 10:46:21 user nova-compute[74278]:     <rng supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>random</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>egd</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>builtin</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </rng>
Oct 30 10:46:21 user nova-compute[74278]:     <filesystem supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='driverType'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>path</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>handle</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>virtiofs</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </filesystem>
Oct 30 10:46:21 user nova-compute[74278]:     <tpm supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>tpm-tis</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>tpm-crb</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>passthrough</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>emulator</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:     </tpm>
Oct 30 10:46:21 user nova-compute[74278]:   </devices>
Oct 30 10:46:21 user nova-compute[74278]:   <features>
Oct 30 10:46:21 user nova-compute[74278]:     <gic supported='no'/>
Oct 30 10:46:21 user nova-compute[74278]:     <vmcoreinfo supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:     <genid supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:     <backingStoreInput supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:     <backup supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:     <sev supported='no'/>
Oct 30 10:46:21 user nova-compute[74278]:   </features>
Oct 30 10:46:21 user nova-compute[74278]: </domainCapabilities>
Oct 30 10:46:21 user nova-compute[74278]:  {{(pid=74278) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 10:46:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 30 10:46:21 user nova-compute[74278]: <domainCapabilities>
Oct 30 10:46:21 user nova-compute[74278]:   <path>/usr/bin/qemu-system-i386</path>
Oct 30 10:46:21 user nova-compute[74278]:   <domain>kvm</domain>
Oct 30 10:46:21 user nova-compute[74278]:   <machine>pc-q35-6.2</machine>
Oct 30 10:46:21 user nova-compute[74278]:   <arch>i686</arch>
Oct 30 10:46:21 user nova-compute[74278]:   <vcpu max='288'/>
Oct 30 10:46:21 user nova-compute[74278]:   <iothreads supported='yes'/>
Oct 30 10:46:21 user nova-compute[74278]:   <os supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:     <enum name='firmware'/>
Oct 30 10:46:21 user nova-compute[74278]:     <loader supported='yes'>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>rom</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>pflash</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:21 user nova-compute[74278]:       <enum name='readonly'>
Oct 30 10:46:21 user nova-compute[74278]:         <value>yes</value>
Oct 30 10:46:21 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:21 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='secure'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </loader>
Oct 30 10:46:22 user nova-compute[74278]:   </os>
Oct 30 10:46:22 user nova-compute[74278]:   <cpu>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='host-passthrough' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='hostPassthroughMigratable'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='maximum' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='maximumMigratable'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>on</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='host-model' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <vendor>Intel</vendor>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ss'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='vmx'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='pcid'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='hypervisor'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='arat'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='umip'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='md-clear'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='stibp'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ssbd'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ibpb'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ibrs'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='amd-stibp'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='disable' name='erms'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='disable' name='lm'/>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='custom' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>qemu64</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>qemu32</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>phenom</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium3</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium2</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>n270</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>kvm64</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>kvm32</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>coreduo</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>core2duo</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>athlon</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Westmere-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Westmere</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Snowridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>SandyBridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Penryn</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G5</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G4</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G3</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G2</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G1</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Nehalem-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Nehalem</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>IvyBridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Icelake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-Rome</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-Milan</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Dhyana</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cooperlake</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Conroe</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>486</model>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:   </cpu>
Oct 30 10:46:22 user nova-compute[74278]:   <memoryBacking supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:     <enum name='sourceType'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>file</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>anonymous</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>memfd</value>
Oct 30 10:46:22 user nova-compute[74278]:     </enum>
Oct 30 10:46:22 user nova-compute[74278]:   </memoryBacking>
Oct 30 10:46:22 user nova-compute[74278]:   <devices>
Oct 30 10:46:22 user nova-compute[74278]:     <disk supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='diskDevice'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>disk</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>cdrom</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>floppy</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>lun</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='bus'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>fdc</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>sata</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </disk>
Oct 30 10:46:22 user nova-compute[74278]:     <graphics supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>sdl</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vnc</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>spice</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>egl-headless</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </graphics>
Oct 30 10:46:22 user nova-compute[74278]:     <video supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='modelType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vga</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>cirrus</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vmvga</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>qxl</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>none</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>bochs</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>ramfb</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </video>
Oct 30 10:46:22 user nova-compute[74278]:     <hostdev supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='mode'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>subsystem</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='startupPolicy'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>default</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>mandatory</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>requisite</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>optional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='subsysType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>pci</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='capsType'/>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='pciBackend'/>
Oct 30 10:46:22 user nova-compute[74278]:     </hostdev>
Oct 30 10:46:22 user nova-compute[74278]:     <rng supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>random</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>egd</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>builtin</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </rng>
Oct 30 10:46:22 user nova-compute[74278]:     <filesystem supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='driverType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>path</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>handle</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtiofs</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </filesystem>
Oct 30 10:46:22 user nova-compute[74278]:     <tpm supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>tpm-tis</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>tpm-crb</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>passthrough</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>emulator</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </tpm>
Oct 30 10:46:22 user nova-compute[74278]:   </devices>
Oct 30 10:46:22 user nova-compute[74278]:   <features>
Oct 30 10:46:22 user nova-compute[74278]:     <gic supported='no'/>
Oct 30 10:46:22 user nova-compute[74278]:     <vmcoreinfo supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <genid supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <backingStoreInput supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <backup supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <sev supported='no'/>
Oct 30 10:46:22 user nova-compute[74278]:   </features>
Oct 30 10:46:22 user nova-compute[74278]: </domainCapabilities>
Oct 30 10:46:22 user nova-compute[74278]:  {{(pid=74278) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 30 10:46:22 user nova-compute[74278]: <domainCapabilities>
Oct 30 10:46:22 user nova-compute[74278]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 30 10:46:22 user nova-compute[74278]:   <domain>kvm</domain>
Oct 30 10:46:22 user nova-compute[74278]:   <machine>pc-i440fx-jammy</machine>
Oct 30 10:46:22 user nova-compute[74278]:   <arch>x86_64</arch>
Oct 30 10:46:22 user nova-compute[74278]:   <vcpu max='255'/>
Oct 30 10:46:22 user nova-compute[74278]:   <iothreads supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:   <os supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:     <enum name='firmware'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>efi</value>
Oct 30 10:46:22 user nova-compute[74278]:     </enum>
Oct 30 10:46:22 user nova-compute[74278]:     <loader supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>rom</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>pflash</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='readonly'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>yes</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='secure'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </loader>
Oct 30 10:46:22 user nova-compute[74278]:   </os>
Oct 30 10:46:22 user nova-compute[74278]:   <cpu>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='host-passthrough' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='hostPassthroughMigratable'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>on</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='maximum' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='maximumMigratable'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>on</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='host-model' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <vendor>Intel</vendor>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ss'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='vmx'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='pcid'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='hypervisor'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='arat'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='umip'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='md-clear'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='stibp'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ssbd'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='invtsc'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ibpb'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ibrs'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='amd-stibp'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='rsba'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='pschange-mc-no'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='disable' name='erms'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='custom' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>qemu64</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>qemu32</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>phenom</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium3</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium2</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>n270</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>kvm64</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>kvm32</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>coreduo</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>core2duo</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>athlon</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Westmere-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Westmere</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Snowridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>SandyBridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Penryn</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G5</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G4</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G3</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G2</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Opteron_G1</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Nehalem</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>IvyBridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Icelake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-Rome</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-Milan</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Dhyana</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cooperlake</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Conroe</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>486</model>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:   </cpu>
Oct 30 10:46:22 user nova-compute[74278]:   <memoryBacking supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:     <enum name='sourceType'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>file</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>anonymous</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>memfd</value>
Oct 30 10:46:22 user nova-compute[74278]:     </enum>
Oct 30 10:46:22 user nova-compute[74278]:   </memoryBacking>
Oct 30 10:46:22 user nova-compute[74278]:   <devices>
Oct 30 10:46:22 user nova-compute[74278]:     <disk supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='diskDevice'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>disk</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>cdrom</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>floppy</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>lun</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='bus'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>ide</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>fdc</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>sata</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </disk>
Oct 30 10:46:22 user nova-compute[74278]:     <graphics supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>sdl</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vnc</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>spice</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>egl-headless</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </graphics>
Oct 30 10:46:22 user nova-compute[74278]:     <video supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='modelType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vga</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>cirrus</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vmvga</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>qxl</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>none</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>bochs</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>ramfb</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </video>
Oct 30 10:46:22 user nova-compute[74278]:     <hostdev supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='mode'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>subsystem</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='startupPolicy'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>default</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>mandatory</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>requisite</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>optional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='subsysType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>pci</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='capsType'/>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='pciBackend'/>
Oct 30 10:46:22 user nova-compute[74278]:     </hostdev>
Oct 30 10:46:22 user nova-compute[74278]:     <rng supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>random</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>egd</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>builtin</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </rng>
Oct 30 10:46:22 user nova-compute[74278]:     <filesystem supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='driverType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>path</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>handle</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtiofs</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </filesystem>
Oct 30 10:46:22 user nova-compute[74278]:     <tpm supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>tpm-tis</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>tpm-crb</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>passthrough</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>emulator</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </tpm>
Oct 30 10:46:22 user nova-compute[74278]:   </devices>
Oct 30 10:46:22 user nova-compute[74278]:   <features>
Oct 30 10:46:22 user nova-compute[74278]:     <gic supported='no'/>
Oct 30 10:46:22 user nova-compute[74278]:     <vmcoreinfo supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <genid supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <backingStoreInput supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <backup supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <sev supported='no'/>
Oct 30 10:46:22 user nova-compute[74278]:   </features>
Oct 30 10:46:22 user nova-compute[74278]: </domainCapabilities>
Oct 30 10:46:22 user nova-compute[74278]:  {{(pid=74278) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 30 10:46:22 user nova-compute[74278]: <domainCapabilities>
Oct 30 10:46:22 user nova-compute[74278]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 30 10:46:22 user nova-compute[74278]:   <domain>kvm</domain>
Oct 30 10:46:22 user nova-compute[74278]:   <machine>pc-q35-jammy</machine>
Oct 30 10:46:22 user nova-compute[74278]:   <arch>x86_64</arch>
Oct 30 10:46:22 user nova-compute[74278]:   <vcpu max='288'/>
Oct 30 10:46:22 user nova-compute[74278]:   <iothreads supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:   <os supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:     <enum name='firmware'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>efi</value>
Oct 30 10:46:22 user nova-compute[74278]:     </enum>
Oct 30 10:46:22 user nova-compute[74278]:     <loader supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>rom</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>pflash</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='readonly'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>yes</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='secure'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>yes</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </loader>
Oct 30 10:46:22 user nova-compute[74278]:   </os>
Oct 30 10:46:22 user nova-compute[74278]:   <cpu>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='host-passthrough' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='hostPassthroughMigratable'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>on</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='maximum' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='maximumMigratable'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>on</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='host-model' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <vendor>Intel</vendor>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ss'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='vmx'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='pcid'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='hypervisor'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='arat'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='umip'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='md-clear'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='stibp'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ssbd'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='invtsc'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ibpb'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ibrs'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='amd-stibp'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='rsba'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='pschange-mc-no'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='disable' name='erms'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='custom' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>qemu64</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>qemu32</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>phenom</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium3</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium2</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>n270</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>kvm64</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>kvm32</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>coreduo</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>core2duo</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>athlon</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Westmere-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Westmere</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Snowridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>SandyBridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Penryn</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G5</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G4</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G3</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G2</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Opteron_G1</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Nehalem</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>IvyBridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Icelake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-Rome</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-Milan</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Dhyana</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cooperlake</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Conroe</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>486</model>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:   </cpu>
Oct 30 10:46:22 user nova-compute[74278]:   <memoryBacking supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:     <enum name='sourceType'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>file</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>anonymous</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>memfd</value>
Oct 30 10:46:22 user nova-compute[74278]:     </enum>
Oct 30 10:46:22 user nova-compute[74278]:   </memoryBacking>
Oct 30 10:46:22 user nova-compute[74278]:   <devices>
Oct 30 10:46:22 user nova-compute[74278]:     <disk supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='diskDevice'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>disk</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>cdrom</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>floppy</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>lun</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='bus'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>fdc</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>sata</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </disk>
Oct 30 10:46:22 user nova-compute[74278]:     <graphics supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>sdl</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vnc</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>spice</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>egl-headless</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </graphics>
Oct 30 10:46:22 user nova-compute[74278]:     <video supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='modelType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vga</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>cirrus</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vmvga</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>qxl</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>none</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>bochs</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>ramfb</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </video>
Oct 30 10:46:22 user nova-compute[74278]:     <hostdev supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='mode'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>subsystem</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='startupPolicy'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>default</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>mandatory</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>requisite</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>optional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='subsysType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>pci</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='capsType'/>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='pciBackend'/>
Oct 30 10:46:22 user nova-compute[74278]:     </hostdev>
Oct 30 10:46:22 user nova-compute[74278]:     <rng supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>random</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>egd</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>builtin</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </rng>
Oct 30 10:46:22 user nova-compute[74278]:     <filesystem supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='driverType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>path</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>handle</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtiofs</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </filesystem>
Oct 30 10:46:22 user nova-compute[74278]:     <tpm supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>tpm-tis</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>tpm-crb</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>passthrough</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>emulator</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </tpm>
Oct 30 10:46:22 user nova-compute[74278]:   </devices>
Oct 30 10:46:22 user nova-compute[74278]:   <features>
Oct 30 10:46:22 user nova-compute[74278]:     <gic supported='no'/>
Oct 30 10:46:22 user nova-compute[74278]:     <vmcoreinfo supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <genid supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <backingStoreInput supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <backup supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <sev supported='no'/>
Oct 30 10:46:22 user nova-compute[74278]:   </features>
Oct 30 10:46:22 user nova-compute[74278]: </domainCapabilities>
Oct 30 10:46:22 user nova-compute[74278]:  {{(pid=74278) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 30 10:46:22 user nova-compute[74278]: <domainCapabilities>
Oct 30 10:46:22 user nova-compute[74278]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 30 10:46:22 user nova-compute[74278]:   <domain>kvm</domain>
Oct 30 10:46:22 user nova-compute[74278]:   <machine>pc-i440fx-6.2</machine>
Oct 30 10:46:22 user nova-compute[74278]:   <arch>x86_64</arch>
Oct 30 10:46:22 user nova-compute[74278]:   <vcpu max='255'/>
Oct 30 10:46:22 user nova-compute[74278]:   <iothreads supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:   <os supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:     <enum name='firmware'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>efi</value>
Oct 30 10:46:22 user nova-compute[74278]:     </enum>
Oct 30 10:46:22 user nova-compute[74278]:     <loader supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>rom</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>pflash</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='readonly'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>yes</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='secure'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </loader>
Oct 30 10:46:22 user nova-compute[74278]:   </os>
Oct 30 10:46:22 user nova-compute[74278]:   <cpu>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='host-passthrough' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='hostPassthroughMigratable'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>on</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='maximum' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='maximumMigratable'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>on</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='host-model' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <vendor>Intel</vendor>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ss'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='vmx'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='pcid'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='hypervisor'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='arat'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='umip'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='md-clear'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='stibp'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ssbd'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='invtsc'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ibpb'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ibrs'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='amd-stibp'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='rsba'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='pschange-mc-no'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='disable' name='erms'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='custom' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>qemu64</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>qemu32</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>phenom</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium3</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium2</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>n270</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>kvm64</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>kvm32</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>coreduo</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>core2duo</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>athlon</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Westmere-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Westmere</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Snowridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>SandyBridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Penryn</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G5</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G4</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G3</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G2</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Opteron_G1</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Nehalem</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>IvyBridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Icelake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-Rome</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-Milan</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Dhyana</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cooperlake</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Conroe</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>486</model>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:   </cpu>
Oct 30 10:46:22 user nova-compute[74278]:   <memoryBacking supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:     <enum name='sourceType'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>file</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>anonymous</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>memfd</value>
Oct 30 10:46:22 user nova-compute[74278]:     </enum>
Oct 30 10:46:22 user nova-compute[74278]:   </memoryBacking>
Oct 30 10:46:22 user nova-compute[74278]:   <devices>
Oct 30 10:46:22 user nova-compute[74278]:     <disk supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='diskDevice'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>disk</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>cdrom</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>floppy</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>lun</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='bus'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>ide</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>fdc</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>sata</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </disk>
Oct 30 10:46:22 user nova-compute[74278]:     <graphics supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>sdl</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vnc</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>spice</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>egl-headless</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </graphics>
Oct 30 10:46:22 user nova-compute[74278]:     <video supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='modelType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vga</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>cirrus</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vmvga</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>qxl</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>none</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>bochs</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>ramfb</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </video>
Oct 30 10:46:22 user nova-compute[74278]:     <hostdev supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='mode'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>subsystem</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='startupPolicy'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>default</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>mandatory</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>requisite</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>optional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='subsysType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>pci</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='capsType'/>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='pciBackend'/>
Oct 30 10:46:22 user nova-compute[74278]:     </hostdev>
Oct 30 10:46:22 user nova-compute[74278]:     <rng supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>random</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>egd</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>builtin</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </rng>
Oct 30 10:46:22 user nova-compute[74278]:     <filesystem supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='driverType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>path</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>handle</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtiofs</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </filesystem>
Oct 30 10:46:22 user nova-compute[74278]:     <tpm supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>tpm-tis</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>tpm-crb</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>passthrough</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>emulator</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </tpm>
Oct 30 10:46:22 user nova-compute[74278]:   </devices>
Oct 30 10:46:22 user nova-compute[74278]:   <features>
Oct 30 10:46:22 user nova-compute[74278]:     <gic supported='no'/>
Oct 30 10:46:22 user nova-compute[74278]:     <vmcoreinfo supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <genid supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <backingStoreInput supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <backup supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <sev supported='no'/>
Oct 30 10:46:22 user nova-compute[74278]:   </features>
Oct 30 10:46:22 user nova-compute[74278]: </domainCapabilities>
Oct 30 10:46:22 user nova-compute[74278]:  {{(pid=74278) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 30 10:46:22 user nova-compute[74278]: <domainCapabilities>
Oct 30 10:46:22 user nova-compute[74278]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 30 10:46:22 user nova-compute[74278]:   <domain>kvm</domain>
Oct 30 10:46:22 user nova-compute[74278]:   <machine>pc-q35-6.2</machine>
Oct 30 10:46:22 user nova-compute[74278]:   <arch>x86_64</arch>
Oct 30 10:46:22 user nova-compute[74278]:   <vcpu max='288'/>
Oct 30 10:46:22 user nova-compute[74278]:   <iothreads supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:   <os supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:     <enum name='firmware'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>efi</value>
Oct 30 10:46:22 user nova-compute[74278]:     </enum>
Oct 30 10:46:22 user nova-compute[74278]:     <loader supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>rom</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>pflash</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='readonly'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>yes</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='secure'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>yes</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>no</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </loader>
Oct 30 10:46:22 user nova-compute[74278]:   </os>
Oct 30 10:46:22 user nova-compute[74278]:   <cpu>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='host-passthrough' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='hostPassthroughMigratable'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>on</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='maximum' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='maximumMigratable'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>on</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>off</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='host-model' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <vendor>Intel</vendor>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ss'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='vmx'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='pcid'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='hypervisor'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='arat'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='umip'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='md-clear'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='stibp'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ssbd'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='invtsc'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ibpb'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='ibrs'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='amd-stibp'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='rsba'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='require' name='pschange-mc-no'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='disable' name='erms'/>
Oct 30 10:46:22 user nova-compute[74278]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:     <mode name='custom' supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>qemu64</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>qemu32</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>phenom</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium3</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium2</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>pentium</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>n270</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>kvm64</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>kvm32</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>coreduo</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>core2duo</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>athlon</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Westmere-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Westmere</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Snowridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Skylake-Client</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>SandyBridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Penryn</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G5</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G4</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G3</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Opteron_G2</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Opteron_G1</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Nehalem</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>IvyBridge</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Icelake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Haswell</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-Rome</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-Milan</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>EPYC</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Dhyana</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cooperlake</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>Conroe</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='no'>Broadwell</model>
Oct 30 10:46:22 user nova-compute[74278]:       <model usable='yes'>486</model>
Oct 30 10:46:22 user nova-compute[74278]:     </mode>
Oct 30 10:46:22 user nova-compute[74278]:   </cpu>
Oct 30 10:46:22 user nova-compute[74278]:   <memoryBacking supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:     <enum name='sourceType'>
Oct 30 10:46:22 user nova-compute[74278]:       <value>file</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>anonymous</value>
Oct 30 10:46:22 user nova-compute[74278]:       <value>memfd</value>
Oct 30 10:46:22 user nova-compute[74278]:     </enum>
Oct 30 10:46:22 user nova-compute[74278]:   </memoryBacking>
Oct 30 10:46:22 user nova-compute[74278]:   <devices>
Oct 30 10:46:22 user nova-compute[74278]:     <disk supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='diskDevice'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>disk</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>cdrom</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>floppy</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>lun</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='bus'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>fdc</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>sata</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </disk>
Oct 30 10:46:22 user nova-compute[74278]:     <graphics supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='type'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>sdl</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vnc</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>spice</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>egl-headless</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </graphics>
Oct 30 10:46:22 user nova-compute[74278]:     <video supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='modelType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vga</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>cirrus</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>vmvga</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>qxl</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>none</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>bochs</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>ramfb</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </video>
Oct 30 10:46:22 user nova-compute[74278]:     <hostdev supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='mode'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>subsystem</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='startupPolicy'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>default</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>mandatory</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>requisite</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>optional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='subsysType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>usb</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>pci</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>scsi</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='capsType'/>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='pciBackend'/>
Oct 30 10:46:22 user nova-compute[74278]:     </hostdev>
Oct 30 10:46:22 user nova-compute[74278]:     <rng supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtio-non-transitional</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>random</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>egd</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>builtin</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </rng>
Oct 30 10:46:22 user nova-compute[74278]:     <filesystem supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='driverType'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>path</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>handle</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>virtiofs</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </filesystem>
Oct 30 10:46:22 user nova-compute[74278]:     <tpm supported='yes'>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='model'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>tpm-tis</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>tpm-crb</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:       <enum name='backendModel'>
Oct 30 10:46:22 user nova-compute[74278]:         <value>passthrough</value>
Oct 30 10:46:22 user nova-compute[74278]:         <value>emulator</value>
Oct 30 10:46:22 user nova-compute[74278]:       </enum>
Oct 30 10:46:22 user nova-compute[74278]:     </tpm>
Oct 30 10:46:22 user nova-compute[74278]:   </devices>
Oct 30 10:46:22 user nova-compute[74278]:   <features>
Oct 30 10:46:22 user nova-compute[74278]:     <gic supported='no'/>
Oct 30 10:46:22 user nova-compute[74278]:     <vmcoreinfo supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <genid supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <backingStoreInput supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <backup supported='yes'/>
Oct 30 10:46:22 user nova-compute[74278]:     <sev supported='no'/>
Oct 30 10:46:22 user nova-compute[74278]:   </features>
Oct 30 10:46:22 user nova-compute[74278]: </domainCapabilities>
Oct 30 10:46:22 user nova-compute[74278]:  {{(pid=74278) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74278) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74278) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Checking secure boot support for host arch (x86_64) {{(pid=74278) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Checking secure boot support for host arch (x86_64) {{(pid=74278) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Checking secure boot support for host arch (x86_64) {{(pid=74278) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 30 10:46:22 user nova-compute[74278]: INFO nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Secure Boot support detected
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] cpu compare xml: <cpu match="exact">
Oct 30 10:46:22 user nova-compute[74278]:   <model>Nehalem</model>
Oct 30 10:46:22 user nova-compute[74278]: </cpu>
Oct 30 10:46:22 user nova-compute[74278]:  {{(pid=74278) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 30 10:46:22 user nova-compute[74278]: INFO nova.virt.node [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Generated node identity ce405684-67ab-45d9-bc83-6af4903bfb15
Oct 30 10:46:22 user nova-compute[74278]: INFO nova.virt.node [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Wrote node identity ce405684-67ab-45d9-bc83-6af4903bfb15 to /opt/stack/data/nova/compute_id
Oct 30 10:46:22 user nova-compute[74278]: WARNING nova.compute.manager [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Compute nodes ['ce405684-67ab-45d9-bc83-6af4903bfb15'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 30 10:46:22 user nova-compute[74278]: INFO nova.compute.manager [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 30 10:46:22 user nova-compute[74278]: WARNING nova.compute.manager [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 30 10:46:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:46:22 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:46:22 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Hypervisor/Node resource view: name=user free_ram=10985MB free_disk=25.973133087158203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:46:22 user nova-compute[74278]: WARNING nova.compute.resource_tracker [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] No compute node record for user:ce405684-67ab-45d9-bc83-6af4903bfb15: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host ce405684-67ab-45d9-bc83-6af4903bfb15 could not be found.
Oct 30 10:46:22 user nova-compute[74278]: INFO nova.compute.resource_tracker [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Compute node record created for user:user with uuid: ce405684-67ab-45d9-bc83-6af4903bfb15
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:46:22 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] [req-63d80e85-4c40-4818-b859-6b14774e2ec5] Created resource provider record via placement API for resource provider with UUID ce405684-67ab-45d9-bc83-6af4903bfb15 and name user.
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74278) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 30 10:46:22 user nova-compute[74278]: INFO nova.virt.libvirt.host [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] kernel doesn't support AMD SEV
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Updating inventory in ProviderTree for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Libvirt baseline CPU <cpu>
Oct 30 10:46:22 user nova-compute[74278]:   <arch>x86_64</arch>
Oct 30 10:46:22 user nova-compute[74278]:   <model>Nehalem</model>
Oct 30 10:46:22 user nova-compute[74278]:   <vendor>Intel</vendor>
Oct 30 10:46:22 user nova-compute[74278]:   <topology sockets="6" cores="1" threads="1"/>
Oct 30 10:46:22 user nova-compute[74278]: </cpu>
Oct 30 10:46:22 user nova-compute[74278]:  {{(pid=74278) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Updated inventory for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Updating resource provider ce405684-67ab-45d9-bc83-6af4903bfb15 generation from 0 to 1 during operation: update_inventory {{(pid=74278) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 30 10:46:22 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Updating inventory in ProviderTree for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 10:46:23 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Updating resource provider ce405684-67ab-45d9-bc83-6af4903bfb15 generation from 1 to 2 during operation: update_traits {{(pid=74278) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 30 10:46:23 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:46:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:46:23 user nova-compute[74278]: DEBUG nova.service [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Creating RPC server for service compute {{(pid=74278) start /opt/stack/nova/nova/service.py:182}}
Oct 30 10:46:23 user nova-compute[74278]: DEBUG nova.service [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] Join ServiceGroup membership for this service compute {{(pid=74278) start /opt/stack/nova/nova/service.py:199}}
Oct 30 10:46:23 user nova-compute[74278]: DEBUG nova.servicegroup.drivers.db [None req-0cc28910-2d1b-47c6-9a59-0a3d4c433a25 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74278) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 30 10:46:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:46:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Didn't find any instances for network info cache update. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:47:13 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:47:13 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:47:13 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=10357MB free_disk=25.876869201660156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:47:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:48:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:48:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:48:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:48:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 10:48:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Didn't find any instances for network info cache update. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 10:48:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:48:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:48:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:48:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:48:14 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:48:14 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:48:14 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=10288MB free_disk=25.940860748291016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:48:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:49:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:49:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:49:14 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:49:14 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:49:14 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 10:49:14 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Didn't find any instances for network info cache update. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 10:49:14 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:49:14 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:49:15 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:49:15 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:49:15 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=10317MB free_disk=25.69451904296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:49:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:49:16 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:49:16 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:50:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:50:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:50:14 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:50:15 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:50:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:50:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 10:50:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Didn't find any instances for network info cache update. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 10:50:15 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:50:15 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:50:16 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:16 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:16 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=9586MB free_disk=25.71466827392578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:50:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:17 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:50:17 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:50:18 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:50:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "d4d34729-e6b8-4f5c-aed8-b6f200287457" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:50:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:21 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:50:21 user nova-compute[74278]: INFO nova.compute.claims [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Claim successful on node user
Oct 30 10:50:21 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:50:21 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:50:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:50:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:50:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:50:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Creating image(s)
Oct 30 10:50:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "/opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "/opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.038s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "da67673a-dbe6-419f-8547-5ca730f14003" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "da67673a-dbe6-419f-8547-5ca730f14003" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:22 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:50:22 user nova-compute[74278]: INFO nova.compute.claims [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Claim successful on node user
Oct 30 10:50:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0.part --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG nova.policy [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '65d733144b1c447daa4cbf134850e41a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '180c08739aa54f4f92350dd647aa73e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0.part --force-share --output=json" returned: 0 in 0.222s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG nova.virt.images [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] 4107584d-f654-453b-972a-abcf1c7a0671 was qcow2, converting to raw {{(pid=74278) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0.part /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0.converted {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.890s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0.part /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0.converted" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0.converted --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:50:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:50:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.490s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:23 user nova-compute[74278]: INFO oslo.privsep.daemon [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2mj4njvo/privsep.sock']
Oct 30 10:50:23 user sudo[83538]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2mj4njvo/privsep.sock
Oct 30 10:50:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:23 user sudo[83538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 30 10:50:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:50:23 user nova-compute[74278]: INFO nova.compute.claims [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Claim successful on node user
Oct 30 10:50:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:50:24 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Creating image(s)
Oct 30 10:50:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "/opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "/opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "/opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG nova.policy [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6e338955c2f4d4fae81e9fbf93eff39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6de366be034e23a4d60302674b76c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.398s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:50:24 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:50:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:50:24 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Creating image(s)
Oct 30 10:50:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "/opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "/opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "/opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:24 user nova-compute[74278]: DEBUG nova.policy [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa0d70bee1b64b939678aec53d77c0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad83f3fea7fc4f308278ab8be165e86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:50:25 user sudo[83538]: pam_unix(sudo:session): session closed for user root
Oct 30 10:50:25 user nova-compute[74278]: INFO oslo.privsep.daemon [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Spawned new privsep daemon via rootwrap
Oct 30 10:50:25 user nova-compute[74278]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 30 10:50:25 user nova-compute[74278]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 30 10:50:25 user nova-compute[74278]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 30 10:50:25 user nova-compute[74278]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83543
Oct 30 10:50:25 user nova-compute[74278]: WARNING oslo_privsep.priv_context [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] privsep daemon already running
Oct 30 10:50:25 user nova-compute[74278]: WARNING oslo_privsep.priv_context [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] privsep daemon already running
Oct 30 10:50:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Successfully created port: 79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:50:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Successfully created port: af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:50:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.233s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.220s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.226s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.188s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Successfully created port: a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk 1073741824" returned: 0 in 0.041s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.228s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.168s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.191s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk 1073741824" returned: 0 in 0.054s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.475s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Cannot resize image /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Ensure instance console log exists: /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Successfully updated port: af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "refresh_cache-55cf7cd9-4e0b-4caa-874e-4963079e3b10" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquired lock "refresh_cache-55cf7cd9-4e0b-4caa-874e-4963079e3b10" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.201s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk 1073741824" returned: 0 in 0.064s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Cannot resize image /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Ensure instance console log exists: /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.216s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:50:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-1d45dbda-6b46-4742-aa00-2f6ed5266d3c req-75c70cb3-c2ec-4a66-ac29-7f6210fb6bce service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Received event network-changed-af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-1d45dbda-6b46-4742-aa00-2f6ed5266d3c req-75c70cb3-c2ec-4a66-ac29-7f6210fb6bce service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Refreshing instance network info cache due to event network-changed-af3e969f-e92f-4ae0-ab01-343c78c675b0. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1d45dbda-6b46-4742-aa00-2f6ed5266d3c req-75c70cb3-c2ec-4a66-ac29-7f6210fb6bce service nova] Acquiring lock "refresh_cache-55cf7cd9-4e0b-4caa-874e-4963079e3b10" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Cannot resize image /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Ensure instance console log exists: /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Updating instance_info_cache with network_info: [{"id": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "address": "fa:16:3e:59:01:36", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3e969f-e9", "ovs_interfaceid": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Releasing lock "refresh_cache-55cf7cd9-4e0b-4caa-874e-4963079e3b10" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Instance network_info: |[{"id": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "address": "fa:16:3e:59:01:36", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3e969f-e9", "ovs_interfaceid": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1d45dbda-6b46-4742-aa00-2f6ed5266d3c req-75c70cb3-c2ec-4a66-ac29-7f6210fb6bce service nova] Acquired lock "refresh_cache-55cf7cd9-4e0b-4caa-874e-4963079e3b10" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.network.neutron [req-1d45dbda-6b46-4742-aa00-2f6ed5266d3c req-75c70cb3-c2ec-4a66-ac29-7f6210fb6bce service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Refreshing network info cache for port af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Start _get_guest_xml network_info=[{"id": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "address": "fa:16:3e:59:01:36", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3e969f-e9", "ovs_interfaceid": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:50:27 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:27 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-660921308',display_name='tempest-ServersNegativeTestJSON-server-660921308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-660921308',id=3,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad83f3fea7fc4f308278ab8be165e86b',ramdisk_id='',reservation_id='r-9f350mht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1521565055',owner_user_name='tempest-ServersNegativeTestJSON-1521565055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:25Z,user_data=None,user_id='fa0d70bee1b64b939678aec53d77c0fd',uuid=55cf7cd9-4e0b-4caa-874e-4963079e3b10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "address": "fa:16:3e:59:01:36", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3e969f-e9", "ovs_interfaceid": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Converting VIF {"id": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "address": "fa:16:3e:59:01:36", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3e969f-e9", "ovs_interfaceid": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:01:36,bridge_name='br-int',has_traffic_filtering=True,id=af3e969f-e92f-4ae0-ab01-343c78c675b0,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3e969f-e9') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.objects.instance [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lazy-loading 'pci_devices' on Instance uuid 55cf7cd9-4e0b-4caa-874e-4963079e3b10 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:50:27 user nova-compute[74278]:   <uuid>55cf7cd9-4e0b-4caa-874e-4963079e3b10</uuid>
Oct 30 10:50:27 user nova-compute[74278]:   <name>instance-00000003</name>
Oct 30 10:50:27 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:50:27 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:50:27 user nova-compute[74278]:   <metadata>
Oct 30 10:50:27 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:50:27 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:50:27 user nova-compute[74278]:       <nova:name>tempest-ServersNegativeTestJSON-server-660921308</nova:name>
Oct 30 10:50:27 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:50:27</nova:creationTime>
Oct 30 10:50:27 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:50:27 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:50:27 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:50:27 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:50:27 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:50:27 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:50:27 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:50:27 user nova-compute[74278]:       <nova:owner>
Oct 30 10:50:27 user nova-compute[74278]:         <nova:user uuid="fa0d70bee1b64b939678aec53d77c0fd">tempest-ServersNegativeTestJSON-1521565055-project-member</nova:user>
Oct 30 10:50:27 user nova-compute[74278]:         <nova:project uuid="ad83f3fea7fc4f308278ab8be165e86b">tempest-ServersNegativeTestJSON-1521565055</nova:project>
Oct 30 10:50:27 user nova-compute[74278]:       </nova:owner>
Oct 30 10:50:27 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:50:27 user nova-compute[74278]:       <nova:ports>
Oct 30 10:50:27 user nova-compute[74278]:         <nova:port uuid="af3e969f-e92f-4ae0-ab01-343c78c675b0">
Oct 30 10:50:27 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 10:50:27 user nova-compute[74278]:         </nova:port>
Oct 30 10:50:27 user nova-compute[74278]:       </nova:ports>
Oct 30 10:50:27 user nova-compute[74278]:     </nova:instance>
Oct 30 10:50:27 user nova-compute[74278]:   </metadata>
Oct 30 10:50:27 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:50:27 user nova-compute[74278]:     <system>
Oct 30 10:50:27 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:50:27 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:50:27 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:50:27 user nova-compute[74278]:       <entry name="serial">55cf7cd9-4e0b-4caa-874e-4963079e3b10</entry>
Oct 30 10:50:27 user nova-compute[74278]:       <entry name="uuid">55cf7cd9-4e0b-4caa-874e-4963079e3b10</entry>
Oct 30 10:50:27 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:50:27 user nova-compute[74278]:     </system>
Oct 30 10:50:27 user nova-compute[74278]:   </sysinfo>
Oct 30 10:50:27 user nova-compute[74278]:   <os>
Oct 30 10:50:27 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:50:27 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:50:27 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:50:27 user nova-compute[74278]:   </os>
Oct 30 10:50:27 user nova-compute[74278]:   <features>
Oct 30 10:50:27 user nova-compute[74278]:     <acpi/>
Oct 30 10:50:27 user nova-compute[74278]:     <apic/>
Oct 30 10:50:27 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:50:27 user nova-compute[74278]:   </features>
Oct 30 10:50:27 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:50:27 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:50:27 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:50:27 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:50:27 user nova-compute[74278]:   </clock>
Oct 30 10:50:27 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:50:27 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:50:27 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:50:27 user nova-compute[74278]:   </cpu>
Oct 30 10:50:27 user nova-compute[74278]:   <devices>
Oct 30 10:50:27 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:50:27 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:50:27 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk"/>
Oct 30 10:50:27 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:50:27 user nova-compute[74278]:     </disk>
Oct 30 10:50:27 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:50:27 user nova-compute[74278]:       <mac address="fa:16:3e:59:01:36"/>
Oct 30 10:50:27 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:27 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:50:27 user nova-compute[74278]:       <target dev="tapaf3e969f-e9"/>
Oct 30 10:50:27 user nova-compute[74278]:     </interface>
Oct 30 10:50:27 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:50:27 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/console.log" append="off"/>
Oct 30 10:50:27 user nova-compute[74278]:     </serial>
Oct 30 10:50:27 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:50:27 user nova-compute[74278]:     <video>
Oct 30 10:50:27 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:27 user nova-compute[74278]:     </video>
Oct 30 10:50:27 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:50:27 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:50:27 user nova-compute[74278]:     </rng>
Oct 30 10:50:27 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:50:27 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:50:27 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:50:27 user nova-compute[74278]:     </memballoon>
Oct 30 10:50:27 user nova-compute[74278]:   </devices>
Oct 30 10:50:27 user nova-compute[74278]: </domain>
Oct 30 10:50:27 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-660921308',display_name='tempest-ServersNegativeTestJSON-server-660921308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-660921308',id=3,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad83f3fea7fc4f308278ab8be165e86b',ramdisk_id='',reservation_id='r-9f350mht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1521565055',owner_user_name='tempest-ServersNegativeTestJSON-1521565055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:25Z,user_data=None,user_id='fa0d70bee1b64b939678aec53d77c0fd',uuid=55cf7cd9-4e0b-4caa-874e-4963079e3b10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "address": "fa:16:3e:59:01:36", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3e969f-e9", "ovs_interfaceid": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Converting VIF {"id": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "address": "fa:16:3e:59:01:36", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3e969f-e9", "ovs_interfaceid": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:01:36,bridge_name='br-int',has_traffic_filtering=True,id=af3e969f-e92f-4ae0-ab01-343c78c675b0,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3e969f-e9') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG os_vif [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:01:36,bridge_name='br-int',has_traffic_filtering=True,id=af3e969f-e92f-4ae0-ab01-343c78c675b0,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3e969f-e9') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Created schema index Interface.name {{(pid=74278) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Created schema index Port.name {{(pid=74278) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Created schema index Bridge.name {{(pid=74278) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [POLLOUT] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bb76913-adbe-53a0-9a5d-7b1b0111e3f6', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:27 user nova-compute[74278]: INFO oslo.privsep.daemon [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpuj9_n7ui/privsep.sock']
Oct 30 10:50:27 user sudo[83594]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpuj9_n7ui/privsep.sock
Oct 30 10:50:27 user sudo[83594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 30 10:50:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG nova.compute.manager [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:50:28 user nova-compute[74278]: INFO nova.compute.claims [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Claim successful on node user
Oct 30 10:50:28 user nova-compute[74278]: DEBUG nova.network.neutron [req-1d45dbda-6b46-4742-aa00-2f6ed5266d3c req-75c70cb3-c2ec-4a66-ac29-7f6210fb6bce service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Updated VIF entry in instance network info cache for port af3e969f-e92f-4ae0-ab01-343c78c675b0. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG nova.network.neutron [req-1d45dbda-6b46-4742-aa00-2f6ed5266d3c req-75c70cb3-c2ec-4a66-ac29-7f6210fb6bce service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Updating instance_info_cache with network_info: [{"id": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "address": "fa:16:3e:59:01:36", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3e969f-e9", "ovs_interfaceid": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1d45dbda-6b46-4742-aa00-2f6ed5266d3c req-75c70cb3-c2ec-4a66-ac29-7f6210fb6bce service nova] Releasing lock "refresh_cache-55cf7cd9-4e0b-4caa-874e-4963079e3b10" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Successfully updated port: 79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "refresh_cache-d4d34729-e6b8-4f5c-aed8-b6f200287457" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquired lock "refresh_cache-d4d34729-e6b8-4f5c-aed8-b6f200287457" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG nova.compute.manager [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG nova.compute.manager [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:50:28 user nova-compute[74278]: DEBUG nova.network.neutron [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:50:29 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.compute.manager [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.compute.manager [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:50:29 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Creating image(s)
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "/opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "/opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "/opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.policy [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7002e346bd664217af927725af208c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a59c309805c1416793e76777407ef388', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:29 user sudo[83594]: pam_unix(sudo:session): session closed for user root
Oct 30 10:50:29 user nova-compute[74278]: INFO oslo.privsep.daemon [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Spawned new privsep daemon via rootwrap
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:50:29 user nova-compute[74278]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 30 10:50:29 user nova-compute[74278]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 30 10:50:29 user nova-compute[74278]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 30 10:50:29 user nova-compute[74278]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83597
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.compute.manager [req-5caca225-67fa-4929-95e7-477f9080c895 req-521c93a8-ee5c-4de1-b83e-d8b0b3078d05 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Received event network-changed-79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.compute.manager [req-5caca225-67fa-4929-95e7-477f9080c895 req-521c93a8-ee5c-4de1-b83e-d8b0b3078d05 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Refreshing instance network info cache due to event network-changed-79987a93-94db-41fb-b192-9d8ceaa56407. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5caca225-67fa-4929-95e7-477f9080c895 req-521c93a8-ee5c-4de1-b83e-d8b0b3078d05 service nova] Acquiring lock "refresh_cache-d4d34729-e6b8-4f5c-aed8-b6f200287457" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.165s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.193s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Successfully updated port: a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk 1073741824" returned: 0 in 0.048s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquired lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "84448e30-982f-4214-a61e-8cc5e122aef3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "84448e30-982f-4214-a61e-8cc5e122aef3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.compute.manager [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.172s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:50:29 user nova-compute[74278]: INFO nova.compute.claims [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Claim successful on node user
Oct 30 10:50:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf3e969f-e9, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf3e969f-e9, col_values=(('qos', UUID('595ddef8-e1ee-4298-a4f8-b7b6b9c6a9e0')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf3e969f-e9, col_values=(('external_ids', {'iface-id': 'af3e969f-e92f-4ae0-ab01-343c78c675b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:01:36', 'vm-uuid': '55cf7cd9-4e0b-4caa-874e-4963079e3b10'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:29 user nova-compute[74278]: INFO os_vif [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:01:36,bridge_name='br-int',has_traffic_filtering=True,id=af3e969f-e92f-4ae0-ab01-343c78c675b0,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3e969f-e9')
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Cannot resize image /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Ensure instance console log exists: /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] No VIF found with MAC fa:16:3e:59:01:36, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Updating instance_info_cache with network_info: [{"id": "79987a93-94db-41fb-b192-9d8ceaa56407", "address": "fa:16:3e:8c:9d:d4", "network": {"id": "e5fe74b4-ac3e-43a1-94b5-80493fdab5c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-349284564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "180c08739aa54f4f92350dd647aa73e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79987a93-94", "ovs_interfaceid": "79987a93-94db-41fb-b192-9d8ceaa56407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Releasing lock "refresh_cache-d4d34729-e6b8-4f5c-aed8-b6f200287457" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Instance network_info: |[{"id": "79987a93-94db-41fb-b192-9d8ceaa56407", "address": "fa:16:3e:8c:9d:d4", "network": {"id": "e5fe74b4-ac3e-43a1-94b5-80493fdab5c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-349284564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "180c08739aa54f4f92350dd647aa73e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79987a93-94", "ovs_interfaceid": "79987a93-94db-41fb-b192-9d8ceaa56407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5caca225-67fa-4929-95e7-477f9080c895 req-521c93a8-ee5c-4de1-b83e-d8b0b3078d05 service nova] Acquired lock "refresh_cache-d4d34729-e6b8-4f5c-aed8-b6f200287457" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.network.neutron [req-5caca225-67fa-4929-95e7-477f9080c895 req-521c93a8-ee5c-4de1-b83e-d8b0b3078d05 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Refreshing network info cache for port 79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Start _get_guest_xml network_info=[{"id": "79987a93-94db-41fb-b192-9d8ceaa56407", "address": "fa:16:3e:8c:9d:d4", "network": {"id": "e5fe74b4-ac3e-43a1-94b5-80493fdab5c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-349284564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "180c08739aa54f4f92350dd647aa73e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79987a93-94", "ovs_interfaceid": "79987a93-94db-41fb-b192-9d8ceaa56407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:50:30 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:30 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1680744787',display_name='tempest-DeleteServersTestJSON-server-1680744787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1680744787',id=1,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='180c08739aa54f4f92350dd647aa73e1',ramdisk_id='',reservation_id='r-mdtz0p9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1024185865',owner_user_name='tempest-DeleteServersTestJSON-1024185865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:22Z,user_data=None,user_id='65d733144b1c447daa4cbf134850e41a',uuid=d4d34729-e6b8-4f5c-aed8-b6f200287457,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79987a93-94db-41fb-b192-9d8ceaa56407", "address": "fa:16:3e:8c:9d:d4", "network": {"id": "e5fe74b4-ac3e-43a1-94b5-80493fdab5c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-349284564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "180c08739aa54f4f92350dd647aa73e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79987a93-94", "ovs_interfaceid": "79987a93-94db-41fb-b192-9d8ceaa56407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Converting VIF {"id": "79987a93-94db-41fb-b192-9d8ceaa56407", "address": "fa:16:3e:8c:9d:d4", "network": {"id": "e5fe74b4-ac3e-43a1-94b5-80493fdab5c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-349284564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "180c08739aa54f4f92350dd647aa73e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79987a93-94", "ovs_interfaceid": "79987a93-94db-41fb-b192-9d8ceaa56407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:9d:d4,bridge_name='br-int',has_traffic_filtering=True,id=79987a93-94db-41fb-b192-9d8ceaa56407,network=Network(e5fe74b4-ac3e-43a1-94b5-80493fdab5c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79987a93-94') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.objects.instance [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lazy-loading 'pci_devices' on Instance uuid d4d34729-e6b8-4f5c-aed8-b6f200287457 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:50:30 user nova-compute[74278]:   <uuid>d4d34729-e6b8-4f5c-aed8-b6f200287457</uuid>
Oct 30 10:50:30 user nova-compute[74278]:   <name>instance-00000001</name>
Oct 30 10:50:30 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:50:30 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:50:30 user nova-compute[74278]:   <metadata>
Oct 30 10:50:30 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:50:30 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:50:30 user nova-compute[74278]:       <nova:name>tempest-DeleteServersTestJSON-server-1680744787</nova:name>
Oct 30 10:50:30 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:50:30</nova:creationTime>
Oct 30 10:50:30 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:50:30 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:50:30 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:50:30 user nova-compute[74278]:       <nova:owner>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:user uuid="65d733144b1c447daa4cbf134850e41a">tempest-DeleteServersTestJSON-1024185865-project-member</nova:user>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:project uuid="180c08739aa54f4f92350dd647aa73e1">tempest-DeleteServersTestJSON-1024185865</nova:project>
Oct 30 10:50:30 user nova-compute[74278]:       </nova:owner>
Oct 30 10:50:30 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:50:30 user nova-compute[74278]:       <nova:ports>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:port uuid="79987a93-94db-41fb-b192-9d8ceaa56407">
Oct 30 10:50:30 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 10:50:30 user nova-compute[74278]:         </nova:port>
Oct 30 10:50:30 user nova-compute[74278]:       </nova:ports>
Oct 30 10:50:30 user nova-compute[74278]:     </nova:instance>
Oct 30 10:50:30 user nova-compute[74278]:   </metadata>
Oct 30 10:50:30 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:50:30 user nova-compute[74278]:     <system>
Oct 30 10:50:30 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:50:30 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:50:30 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:50:30 user nova-compute[74278]:       <entry name="serial">d4d34729-e6b8-4f5c-aed8-b6f200287457</entry>
Oct 30 10:50:30 user nova-compute[74278]:       <entry name="uuid">d4d34729-e6b8-4f5c-aed8-b6f200287457</entry>
Oct 30 10:50:30 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:50:30 user nova-compute[74278]:     </system>
Oct 30 10:50:30 user nova-compute[74278]:   </sysinfo>
Oct 30 10:50:30 user nova-compute[74278]:   <os>
Oct 30 10:50:30 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:50:30 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:50:30 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:50:30 user nova-compute[74278]:   </os>
Oct 30 10:50:30 user nova-compute[74278]:   <features>
Oct 30 10:50:30 user nova-compute[74278]:     <acpi/>
Oct 30 10:50:30 user nova-compute[74278]:     <apic/>
Oct 30 10:50:30 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:50:30 user nova-compute[74278]:   </features>
Oct 30 10:50:30 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:50:30 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:50:30 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:50:30 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:50:30 user nova-compute[74278]:   </clock>
Oct 30 10:50:30 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:50:30 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:50:30 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:50:30 user nova-compute[74278]:   </cpu>
Oct 30 10:50:30 user nova-compute[74278]:   <devices>
Oct 30 10:50:30 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:50:30 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:50:30 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk"/>
Oct 30 10:50:30 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:50:30 user nova-compute[74278]:     </disk>
Oct 30 10:50:30 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:50:30 user nova-compute[74278]:       <mac address="fa:16:3e:8c:9d:d4"/>
Oct 30 10:50:30 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:30 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:50:30 user nova-compute[74278]:       <target dev="tap79987a93-94"/>
Oct 30 10:50:30 user nova-compute[74278]:     </interface>
Oct 30 10:50:30 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:50:30 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/console.log" append="off"/>
Oct 30 10:50:30 user nova-compute[74278]:     </serial>
Oct 30 10:50:30 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:50:30 user nova-compute[74278]:     <video>
Oct 30 10:50:30 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:30 user nova-compute[74278]:     </video>
Oct 30 10:50:30 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:50:30 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:50:30 user nova-compute[74278]:     </rng>
Oct 30 10:50:30 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:50:30 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:50:30 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:50:30 user nova-compute[74278]:     </memballoon>
Oct 30 10:50:30 user nova-compute[74278]:   </devices>
Oct 30 10:50:30 user nova-compute[74278]: </domain>
Oct 30 10:50:30 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1680744787',display_name='tempest-DeleteServersTestJSON-server-1680744787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1680744787',id=1,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='180c08739aa54f4f92350dd647aa73e1',ramdisk_id='',reservation_id='r-mdtz0p9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1024185865',owner_user_name='tempest-DeleteServersTestJSON-1024185865-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:22Z,user_data=None,user_id='65d733144b1c447daa4cbf134850e41a',uuid=d4d34729-e6b8-4f5c-aed8-b6f200287457,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79987a93-94db-41fb-b192-9d8ceaa56407", "address": "fa:16:3e:8c:9d:d4", "network": {"id": "e5fe74b4-ac3e-43a1-94b5-80493fdab5c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-349284564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "180c08739aa54f4f92350dd647aa73e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79987a93-94", "ovs_interfaceid": "79987a93-94db-41fb-b192-9d8ceaa56407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Converting VIF {"id": "79987a93-94db-41fb-b192-9d8ceaa56407", "address": "fa:16:3e:8c:9d:d4", "network": {"id": "e5fe74b4-ac3e-43a1-94b5-80493fdab5c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-349284564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "180c08739aa54f4f92350dd647aa73e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79987a93-94", "ovs_interfaceid": "79987a93-94db-41fb-b192-9d8ceaa56407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:9d:d4,bridge_name='br-int',has_traffic_filtering=True,id=79987a93-94db-41fb-b192-9d8ceaa56407,network=Network(e5fe74b4-ac3e-43a1-94b5-80493fdab5c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79987a93-94') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG os_vif [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:9d:d4,bridge_name='br-int',has_traffic_filtering=True,id=79987a93-94db-41fb-b192-9d8ceaa56407,network=Network(e5fe74b4-ac3e-43a1-94b5-80493fdab5c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79987a93-94') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '438f3e00-1192-58f5-818b-b5438914031e', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79987a93-94, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79987a93-94, col_values=(('qos', UUID('46220f1c-5439-462a-8ec8-fdf75f24185e')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79987a93-94, col_values=(('external_ids', {'iface-id': '79987a93-94db-41fb-b192-9d8ceaa56407', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:9d:d4', 'vm-uuid': 'd4d34729-e6b8-4f5c-aed8-b6f200287457'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.network.neutron [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:30 user nova-compute[74278]: INFO os_vif [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:9d:d4,bridge_name='br-int',has_traffic_filtering=True,id=79987a93-94db-41fb-b192-9d8ceaa56407,network=Network(e5fe74b4-ac3e-43a1-94b5-80493fdab5c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79987a93-94')
Oct 30 10:50:30 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] No VIF found with MAC fa:16:3e:8c:9d:d4, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:50:30 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Creating image(s)
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "/opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "/opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "/opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Updating instance_info_cache with network_info: [{"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Releasing lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Instance network_info: |[{"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Start _get_guest_xml network_info=[{"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:50:30 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:30 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.policy [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31e7e6847ec0415fba0fd909c014e802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43bf73deda348f08290daf640768705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1492633529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1492633529',id=2,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-rc5qhn2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:24Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=da67673a-dbe6-419f-8547-5ca730f14003,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:20:bf,bridge_name='br-int',has_traffic_filtering=True,id=a2d0d57d-3df3-474d-b718-c539fb517f32,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2d0d57d-3d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.objects.instance [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'pci_devices' on Instance uuid da67673a-dbe6-419f-8547-5ca730f14003 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.193s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:50:30 user nova-compute[74278]:   <uuid>da67673a-dbe6-419f-8547-5ca730f14003</uuid>
Oct 30 10:50:30 user nova-compute[74278]:   <name>instance-00000002</name>
Oct 30 10:50:30 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:50:30 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:50:30 user nova-compute[74278]:   <metadata>
Oct 30 10:50:30 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:50:30 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:50:30 user nova-compute[74278]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1492633529</nova:name>
Oct 30 10:50:30 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:50:30</nova:creationTime>
Oct 30 10:50:30 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:50:30 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:50:30 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:50:30 user nova-compute[74278]:       <nova:owner>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:user uuid="e6e338955c2f4d4fae81e9fbf93eff39">tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member</nova:user>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:project uuid="0f6de366be034e23a4d60302674b76c9">tempest-ServerBootFromVolumeStableRescueTest-1058902108</nova:project>
Oct 30 10:50:30 user nova-compute[74278]:       </nova:owner>
Oct 30 10:50:30 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:50:30 user nova-compute[74278]:       <nova:ports>
Oct 30 10:50:30 user nova-compute[74278]:         <nova:port uuid="a2d0d57d-3df3-474d-b718-c539fb517f32">
Oct 30 10:50:30 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 30 10:50:30 user nova-compute[74278]:         </nova:port>
Oct 30 10:50:30 user nova-compute[74278]:       </nova:ports>
Oct 30 10:50:30 user nova-compute[74278]:     </nova:instance>
Oct 30 10:50:30 user nova-compute[74278]:   </metadata>
Oct 30 10:50:30 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:50:30 user nova-compute[74278]:     <system>
Oct 30 10:50:30 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:50:30 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:50:30 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:50:30 user nova-compute[74278]:       <entry name="serial">da67673a-dbe6-419f-8547-5ca730f14003</entry>
Oct 30 10:50:30 user nova-compute[74278]:       <entry name="uuid">da67673a-dbe6-419f-8547-5ca730f14003</entry>
Oct 30 10:50:30 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:50:30 user nova-compute[74278]:     </system>
Oct 30 10:50:30 user nova-compute[74278]:   </sysinfo>
Oct 30 10:50:30 user nova-compute[74278]:   <os>
Oct 30 10:50:30 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:50:30 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:50:30 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:50:30 user nova-compute[74278]:   </os>
Oct 30 10:50:30 user nova-compute[74278]:   <features>
Oct 30 10:50:30 user nova-compute[74278]:     <acpi/>
Oct 30 10:50:30 user nova-compute[74278]:     <apic/>
Oct 30 10:50:30 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:50:30 user nova-compute[74278]:   </features>
Oct 30 10:50:30 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:50:30 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:50:30 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:50:30 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:50:30 user nova-compute[74278]:   </clock>
Oct 30 10:50:30 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:50:30 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:50:30 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:50:30 user nova-compute[74278]:   </cpu>
Oct 30 10:50:30 user nova-compute[74278]:   <devices>
Oct 30 10:50:30 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:50:30 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:50:30 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk"/>
Oct 30 10:50:30 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:50:30 user nova-compute[74278]:     </disk>
Oct 30 10:50:30 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:50:30 user nova-compute[74278]:       <mac address="fa:16:3e:bf:20:bf"/>
Oct 30 10:50:30 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:30 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:50:30 user nova-compute[74278]:       <target dev="tapa2d0d57d-3d"/>
Oct 30 10:50:30 user nova-compute[74278]:     </interface>
Oct 30 10:50:30 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:50:30 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/console.log" append="off"/>
Oct 30 10:50:30 user nova-compute[74278]:     </serial>
Oct 30 10:50:30 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:50:30 user nova-compute[74278]:     <video>
Oct 30 10:50:30 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:30 user nova-compute[74278]:     </video>
Oct 30 10:50:30 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:50:30 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:50:30 user nova-compute[74278]:     </rng>
Oct 30 10:50:30 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:50:30 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:50:30 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:50:30 user nova-compute[74278]:     </memballoon>
Oct 30 10:50:30 user nova-compute[74278]:   </devices>
Oct 30 10:50:30 user nova-compute[74278]: </domain>
Oct 30 10:50:30 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1492633529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1492633529',id=2,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-rc5qhn2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:24Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=da67673a-dbe6-419f-8547-5ca730f14003,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:20:bf,bridge_name='br-int',has_traffic_filtering=True,id=a2d0d57d-3df3-474d-b718-c539fb517f32,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2d0d57d-3d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG os_vif [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:20:bf,bridge_name='br-int',has_traffic_filtering=True,id=a2d0d57d-3df3-474d-b718-c539fb517f32,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2d0d57d-3d') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '77a7f178-a67a-52f8-844f-ce741c12075b', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2d0d57d-3d, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2d0d57d-3d, col_values=(('qos', UUID('43dade31-dcaa-46b9-a819-2c177b9307a0')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2d0d57d-3d, col_values=(('external_ids', {'iface-id': 'a2d0d57d-3df3-474d-b718-c539fb517f32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:20:bf', 'vm-uuid': 'da67673a-dbe6-419f-8547-5ca730f14003'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:31 user nova-compute[74278]: INFO os_vif [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:20:bf,bridge_name='br-int',has_traffic_filtering=True,id=a2d0d57d-3df3-474d-b718-c539fb517f32,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2d0d57d-3d')
Oct 30 10:50:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No VIF found with MAC fa:16:3e:bf:20:bf, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk 1073741824" returned: 0 in 0.050s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG nova.network.neutron [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Successfully created port: 346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG nova.network.neutron [req-5caca225-67fa-4929-95e7-477f9080c895 req-521c93a8-ee5c-4de1-b83e-d8b0b3078d05 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Updated VIF entry in instance network info cache for port 79987a93-94db-41fb-b192-9d8ceaa56407. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG nova.network.neutron [req-5caca225-67fa-4929-95e7-477f9080c895 req-521c93a8-ee5c-4de1-b83e-d8b0b3078d05 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Updating instance_info_cache with network_info: [{"id": "79987a93-94db-41fb-b192-9d8ceaa56407", "address": "fa:16:3e:8c:9d:d4", "network": {"id": "e5fe74b4-ac3e-43a1-94b5-80493fdab5c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-349284564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "180c08739aa54f4f92350dd647aa73e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79987a93-94", "ovs_interfaceid": "79987a93-94db-41fb-b192-9d8ceaa56407", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5caca225-67fa-4929-95e7-477f9080c895 req-521c93a8-ee5c-4de1-b83e-d8b0b3078d05 service nova] Releasing lock "refresh_cache-d4d34729-e6b8-4f5c-aed8-b6f200287457" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG nova.compute.manager [req-3746e5f0-e35d-4fc3-aaf2-7372cae75874 req-9d631031-62c2-4dc5-8726-4dea5b35dcfe service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Received event network-changed-a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG nova.compute.manager [req-3746e5f0-e35d-4fc3-aaf2-7372cae75874 req-9d631031-62c2-4dc5-8726-4dea5b35dcfe service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Refreshing instance network info cache due to event network-changed-a2d0d57d-3df3-474d-b718-c539fb517f32. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3746e5f0-e35d-4fc3-aaf2-7372cae75874 req-9d631031-62c2-4dc5-8726-4dea5b35dcfe service nova] Acquiring lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3746e5f0-e35d-4fc3-aaf2-7372cae75874 req-9d631031-62c2-4dc5-8726-4dea5b35dcfe service nova] Acquired lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG nova.network.neutron [req-3746e5f0-e35d-4fc3-aaf2-7372cae75874 req-9d631031-62c2-4dc5-8726-4dea5b35dcfe service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Refreshing network info cache for port a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Cannot resize image /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Ensure instance console log exists: /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:32 user nova-compute[74278]: DEBUG nova.network.neutron [req-3746e5f0-e35d-4fc3-aaf2-7372cae75874 req-9d631031-62c2-4dc5-8726-4dea5b35dcfe service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Updated VIF entry in instance network info cache for port a2d0d57d-3df3-474d-b718-c539fb517f32. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:50:32 user nova-compute[74278]: DEBUG nova.network.neutron [req-3746e5f0-e35d-4fc3-aaf2-7372cae75874 req-9d631031-62c2-4dc5-8726-4dea5b35dcfe service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Updating instance_info_cache with network_info: [{"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3746e5f0-e35d-4fc3-aaf2-7372cae75874 req-9d631031-62c2-4dc5-8726-4dea5b35dcfe service nova] Releasing lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:32 user nova-compute[74278]: DEBUG nova.network.neutron [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Successfully created port: be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:50:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.network.neutron [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Successfully updated port: 346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquired lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.network.neutron [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.compute.manager [req-59c50501-ec7b-4ee2-9f77-ccf6a19fd3c2 req-319b5294-b261-4247-b8c3-129fff0f8ca5 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-changed-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.compute.manager [req-59c50501-ec7b-4ee2-9f77-ccf6a19fd3c2 req-319b5294-b261-4247-b8c3-129fff0f8ca5 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Refreshing instance network info cache due to event network-changed-346d37bb-4749-43ab-b83e-c0472def78b2. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-59c50501-ec7b-4ee2-9f77-ccf6a19fd3c2 req-319b5294-b261-4247-b8c3-129fff0f8ca5 service nova] Acquiring lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.network.neutron [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.network.neutron [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating instance_info_cache with network_info: [{"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Releasing lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.compute.manager [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Instance network_info: |[{"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-59c50501-ec7b-4ee2-9f77-ccf6a19fd3c2 req-319b5294-b261-4247-b8c3-129fff0f8ca5 service nova] Acquired lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.network.neutron [req-59c50501-ec7b-4ee2-9f77-ccf6a19fd3c2 req-319b5294-b261-4247-b8c3-129fff0f8ca5 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Refreshing network info cache for port 346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Start _get_guest_xml network_info=[{"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:50:33 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:33 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1697547587',display_name='tempest-ServerActionsTestOtherB-server-1697547587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1697547587',id=4,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxtrS9IHVw9VJCYjUF6eDWBKHwb7bFWD3A669NQggiEpEfM7XQnDLYLkziVDxGhK2ctlm9Mx1VSfhVfRehAdJNYHfhfvjHZCeNc+QL1vrbZckvK1AnRE3E7SPpnRLWh5Q==',key_name='tempest-keypair-979570287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a59c309805c1416793e76777407ef388',ramdisk_id='',reservation_id='r-f0ytqg1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1708015848',owner_user_name='tempest-ServerActionsTestOtherB-1708015848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7002e346bd664217af927725af208c54',uuid=25c5ad55-f85b-4371-8bdf-95a6a0f4d73d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converting VIF {"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.objects.instance [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lazy-loading 'pci_devices' on Instance uuid 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:50:33 user nova-compute[74278]:   <uuid>25c5ad55-f85b-4371-8bdf-95a6a0f4d73d</uuid>
Oct 30 10:50:33 user nova-compute[74278]:   <name>instance-00000004</name>
Oct 30 10:50:33 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:50:33 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:50:33 user nova-compute[74278]:   <metadata>
Oct 30 10:50:33 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:50:33 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:50:33 user nova-compute[74278]:       <nova:name>tempest-ServerActionsTestOtherB-server-1697547587</nova:name>
Oct 30 10:50:33 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:50:33</nova:creationTime>
Oct 30 10:50:33 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:50:33 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:50:33 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:50:33 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:50:33 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:50:33 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:50:33 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:50:33 user nova-compute[74278]:       <nova:owner>
Oct 30 10:50:33 user nova-compute[74278]:         <nova:user uuid="7002e346bd664217af927725af208c54">tempest-ServerActionsTestOtherB-1708015848-project-member</nova:user>
Oct 30 10:50:33 user nova-compute[74278]:         <nova:project uuid="a59c309805c1416793e76777407ef388">tempest-ServerActionsTestOtherB-1708015848</nova:project>
Oct 30 10:50:33 user nova-compute[74278]:       </nova:owner>
Oct 30 10:50:33 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:50:33 user nova-compute[74278]:       <nova:ports>
Oct 30 10:50:33 user nova-compute[74278]:         <nova:port uuid="346d37bb-4749-43ab-b83e-c0472def78b2">
Oct 30 10:50:33 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 10:50:33 user nova-compute[74278]:         </nova:port>
Oct 30 10:50:33 user nova-compute[74278]:       </nova:ports>
Oct 30 10:50:33 user nova-compute[74278]:     </nova:instance>
Oct 30 10:50:33 user nova-compute[74278]:   </metadata>
Oct 30 10:50:33 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:50:33 user nova-compute[74278]:     <system>
Oct 30 10:50:33 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:50:33 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:50:33 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:50:33 user nova-compute[74278]:       <entry name="serial">25c5ad55-f85b-4371-8bdf-95a6a0f4d73d</entry>
Oct 30 10:50:33 user nova-compute[74278]:       <entry name="uuid">25c5ad55-f85b-4371-8bdf-95a6a0f4d73d</entry>
Oct 30 10:50:33 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:50:33 user nova-compute[74278]:     </system>
Oct 30 10:50:33 user nova-compute[74278]:   </sysinfo>
Oct 30 10:50:33 user nova-compute[74278]:   <os>
Oct 30 10:50:33 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:50:33 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:50:33 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:50:33 user nova-compute[74278]:   </os>
Oct 30 10:50:33 user nova-compute[74278]:   <features>
Oct 30 10:50:33 user nova-compute[74278]:     <acpi/>
Oct 30 10:50:33 user nova-compute[74278]:     <apic/>
Oct 30 10:50:33 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:50:33 user nova-compute[74278]:   </features>
Oct 30 10:50:33 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:50:33 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:50:33 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:50:33 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:50:33 user nova-compute[74278]:   </clock>
Oct 30 10:50:33 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:50:33 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:50:33 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:50:33 user nova-compute[74278]:   </cpu>
Oct 30 10:50:33 user nova-compute[74278]:   <devices>
Oct 30 10:50:33 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:50:33 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:50:33 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk"/>
Oct 30 10:50:33 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:50:33 user nova-compute[74278]:     </disk>
Oct 30 10:50:33 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:50:33 user nova-compute[74278]:       <mac address="fa:16:3e:8b:ee:5f"/>
Oct 30 10:50:33 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:33 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:50:33 user nova-compute[74278]:       <target dev="tap346d37bb-47"/>
Oct 30 10:50:33 user nova-compute[74278]:     </interface>
Oct 30 10:50:33 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:50:33 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/console.log" append="off"/>
Oct 30 10:50:33 user nova-compute[74278]:     </serial>
Oct 30 10:50:33 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:50:33 user nova-compute[74278]:     <video>
Oct 30 10:50:33 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:33 user nova-compute[74278]:     </video>
Oct 30 10:50:33 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:50:33 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:50:33 user nova-compute[74278]:     </rng>
Oct 30 10:50:33 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:50:33 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:50:33 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:50:33 user nova-compute[74278]:     </memballoon>
Oct 30 10:50:33 user nova-compute[74278]:   </devices>
Oct 30 10:50:33 user nova-compute[74278]: </domain>
Oct 30 10:50:33 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1697547587',display_name='tempest-ServerActionsTestOtherB-server-1697547587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1697547587',id=4,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxtrS9IHVw9VJCYjUF6eDWBKHwb7bFWD3A669NQggiEpEfM7XQnDLYLkziVDxGhK2ctlm9Mx1VSfhVfRehAdJNYHfhfvjHZCeNc+QL1vrbZckvK1AnRE3E7SPpnRLWh5Q==',key_name='tempest-keypair-979570287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a59c309805c1416793e76777407ef388',ramdisk_id='',reservation_id='r-f0ytqg1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1708015848',owner_user_name='tempest-ServerActionsTestOtherB-1708015848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7002e346bd664217af927725af208c54',uuid=25c5ad55-f85b-4371-8bdf-95a6a0f4d73d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converting VIF {"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG os_vif [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8c1aa7a-a83b-53c9-bfbd-11924bfc616d', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap346d37bb-47, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap346d37bb-47, col_values=(('qos', UUID('4d98db29-184b-493e-a433-65ba17e55615')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap346d37bb-47, col_values=(('external_ids', {'iface-id': '346d37bb-4749-43ab-b83e-c0472def78b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:ee:5f', 'vm-uuid': '25c5ad55-f85b-4371-8bdf-95a6a0f4d73d'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:33 user nova-compute[74278]: INFO os_vif [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47')
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.network.neutron [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Successfully updated port: be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] No VIF found with MAC fa:16:3e:8b:ee:5f, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "refresh_cache-84448e30-982f-4214-a61e-8cc5e122aef3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquired lock "refresh_cache-84448e30-982f-4214-a61e-8cc5e122aef3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.network.neutron [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.network.neutron [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.network.neutron [req-59c50501-ec7b-4ee2-9f77-ccf6a19fd3c2 req-319b5294-b261-4247-b8c3-129fff0f8ca5 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updated VIF entry in instance network info cache for port 346d37bb-4749-43ab-b83e-c0472def78b2. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.network.neutron [req-59c50501-ec7b-4ee2-9f77-ccf6a19fd3c2 req-319b5294-b261-4247-b8c3-129fff0f8ca5 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating instance_info_cache with network_info: [{"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-59c50501-ec7b-4ee2-9f77-ccf6a19fd3c2 req-319b5294-b261-4247-b8c3-129fff0f8ca5 service nova] Releasing lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.network.neutron [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Updating instance_info_cache with network_info: [{"id": "be704baf-2542-497e-af45-bffa287fc1cd", "address": "fa:16:3e:27:25:f0", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe704baf-25", "ovs_interfaceid": "be704baf-2542-497e-af45-bffa287fc1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Releasing lock "refresh_cache-84448e30-982f-4214-a61e-8cc5e122aef3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.compute.manager [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Instance network_info: |[{"id": "be704baf-2542-497e-af45-bffa287fc1cd", "address": "fa:16:3e:27:25:f0", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe704baf-25", "ovs_interfaceid": "be704baf-2542-497e-af45-bffa287fc1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Start _get_guest_xml network_info=[{"id": "be704baf-2542-497e-af45-bffa287fc1cd", "address": "fa:16:3e:27:25:f0", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe704baf-25", "ovs_interfaceid": "be704baf-2542-497e-af45-bffa287fc1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:50:34 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:34 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:50:34 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1397790136',display_name='tempest-AttachVolumeNegativeTest-server-1397790136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1397790136',id=5,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlqP0t8QpmrNP/69xD3v1rWPdWuTwaxXsGGjDgIlhcIChX1IaSevGhhO0+C7HTcBvTquT5PC1j7YKyF2o6wPbODsbubB6OU0CJ9itw28tASMyjK5G223srJk+oVx5zWvw==',key_name='tempest-keypair-1464136291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43bf73deda348f08290daf640768705',ramdisk_id='',reservation_id='r-4xbez1up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-871157650',owner_user_name='tempest-AttachVolumeNegativeTest-871157650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31e7e6847ec0415fba0fd909c014e802',uuid=84448e30-982f-4214-a61e-8cc5e122aef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be704baf-2542-497e-af45-bffa287fc1cd", "address": "fa:16:3e:27:25:f0", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe704baf-25", "ovs_interfaceid": "be704baf-2542-497e-af45-bffa287fc1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converting VIF {"id": "be704baf-2542-497e-af45-bffa287fc1cd", "address": "fa:16:3e:27:25:f0", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe704baf-25", "ovs_interfaceid": "be704baf-2542-497e-af45-bffa287fc1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:25:f0,bridge_name='br-int',has_traffic_filtering=True,id=be704baf-2542-497e-af45-bffa287fc1cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe704baf-25') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.objects.instance [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'pci_devices' on Instance uuid 84448e30-982f-4214-a61e-8cc5e122aef3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:50:35 user nova-compute[74278]:   <uuid>84448e30-982f-4214-a61e-8cc5e122aef3</uuid>
Oct 30 10:50:35 user nova-compute[74278]:   <name>instance-00000005</name>
Oct 30 10:50:35 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:50:35 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:50:35 user nova-compute[74278]:   <metadata>
Oct 30 10:50:35 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:50:35 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:50:35 user nova-compute[74278]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1397790136</nova:name>
Oct 30 10:50:35 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:50:34</nova:creationTime>
Oct 30 10:50:35 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:50:35 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:50:35 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:50:35 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:50:35 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:50:35 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:50:35 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:50:35 user nova-compute[74278]:       <nova:owner>
Oct 30 10:50:35 user nova-compute[74278]:         <nova:user uuid="31e7e6847ec0415fba0fd909c014e802">tempest-AttachVolumeNegativeTest-871157650-project-member</nova:user>
Oct 30 10:50:35 user nova-compute[74278]:         <nova:project uuid="b43bf73deda348f08290daf640768705">tempest-AttachVolumeNegativeTest-871157650</nova:project>
Oct 30 10:50:35 user nova-compute[74278]:       </nova:owner>
Oct 30 10:50:35 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:50:35 user nova-compute[74278]:       <nova:ports>
Oct 30 10:50:35 user nova-compute[74278]:         <nova:port uuid="be704baf-2542-497e-af45-bffa287fc1cd">
Oct 30 10:50:35 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 10:50:35 user nova-compute[74278]:         </nova:port>
Oct 30 10:50:35 user nova-compute[74278]:       </nova:ports>
Oct 30 10:50:35 user nova-compute[74278]:     </nova:instance>
Oct 30 10:50:35 user nova-compute[74278]:   </metadata>
Oct 30 10:50:35 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:50:35 user nova-compute[74278]:     <system>
Oct 30 10:50:35 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:50:35 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:50:35 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:50:35 user nova-compute[74278]:       <entry name="serial">84448e30-982f-4214-a61e-8cc5e122aef3</entry>
Oct 30 10:50:35 user nova-compute[74278]:       <entry name="uuid">84448e30-982f-4214-a61e-8cc5e122aef3</entry>
Oct 30 10:50:35 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:50:35 user nova-compute[74278]:     </system>
Oct 30 10:50:35 user nova-compute[74278]:   </sysinfo>
Oct 30 10:50:35 user nova-compute[74278]:   <os>
Oct 30 10:50:35 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:50:35 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:50:35 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:50:35 user nova-compute[74278]:   </os>
Oct 30 10:50:35 user nova-compute[74278]:   <features>
Oct 30 10:50:35 user nova-compute[74278]:     <acpi/>
Oct 30 10:50:35 user nova-compute[74278]:     <apic/>
Oct 30 10:50:35 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:50:35 user nova-compute[74278]:   </features>
Oct 30 10:50:35 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:50:35 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:50:35 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:50:35 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:50:35 user nova-compute[74278]:   </clock>
Oct 30 10:50:35 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:50:35 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:50:35 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:50:35 user nova-compute[74278]:   </cpu>
Oct 30 10:50:35 user nova-compute[74278]:   <devices>
Oct 30 10:50:35 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:50:35 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:50:35 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk"/>
Oct 30 10:50:35 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:50:35 user nova-compute[74278]:     </disk>
Oct 30 10:50:35 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:50:35 user nova-compute[74278]:       <mac address="fa:16:3e:27:25:f0"/>
Oct 30 10:50:35 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:35 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:50:35 user nova-compute[74278]:       <target dev="tapbe704baf-25"/>
Oct 30 10:50:35 user nova-compute[74278]:     </interface>
Oct 30 10:50:35 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:50:35 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/console.log" append="off"/>
Oct 30 10:50:35 user nova-compute[74278]:     </serial>
Oct 30 10:50:35 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:50:35 user nova-compute[74278]:     <video>
Oct 30 10:50:35 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:35 user nova-compute[74278]:     </video>
Oct 30 10:50:35 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:50:35 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:50:35 user nova-compute[74278]:     </rng>
Oct 30 10:50:35 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:50:35 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:50:35 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:50:35 user nova-compute[74278]:     </memballoon>
Oct 30 10:50:35 user nova-compute[74278]:   </devices>
Oct 30 10:50:35 user nova-compute[74278]: </domain>
Oct 30 10:50:35 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1397790136',display_name='tempest-AttachVolumeNegativeTest-server-1397790136',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1397790136',id=5,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlqP0t8QpmrNP/69xD3v1rWPdWuTwaxXsGGjDgIlhcIChX1IaSevGhhO0+C7HTcBvTquT5PC1j7YKyF2o6wPbODsbubB6OU0CJ9itw28tASMyjK5G223srJk+oVx5zWvw==',key_name='tempest-keypair-1464136291',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43bf73deda348f08290daf640768705',ramdisk_id='',reservation_id='r-4xbez1up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-871157650',owner_user_name='tempest-AttachVolumeNegativeTest-871157650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31e7e6847ec0415fba0fd909c014e802',uuid=84448e30-982f-4214-a61e-8cc5e122aef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be704baf-2542-497e-af45-bffa287fc1cd", "address": "fa:16:3e:27:25:f0", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe704baf-25", "ovs_interfaceid": "be704baf-2542-497e-af45-bffa287fc1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converting VIF {"id": "be704baf-2542-497e-af45-bffa287fc1cd", "address": "fa:16:3e:27:25:f0", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe704baf-25", "ovs_interfaceid": "be704baf-2542-497e-af45-bffa287fc1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:25:f0,bridge_name='br-int',has_traffic_filtering=True,id=be704baf-2542-497e-af45-bffa287fc1cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe704baf-25') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG os_vif [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:25:f0,bridge_name='br-int',has_traffic_filtering=True,id=be704baf-2542-497e-af45-bffa287fc1cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe704baf-25') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90eea287-b7a8-5cea-b48d-a2f2171ae7a2', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe704baf-25, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe704baf-25, col_values=(('qos', UUID('d21e30c1-611c-4df9-8c59-2302a84b9da8')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe704baf-25, col_values=(('external_ids', {'iface-id': 'be704baf-2542-497e-af45-bffa287fc1cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:25:f0', 'vm-uuid': '84448e30-982f-4214-a61e-8cc5e122aef3'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:35 user nova-compute[74278]: INFO os_vif [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:25:f0,bridge_name='br-int',has_traffic_filtering=True,id=be704baf-2542-497e-af45-bffa287fc1cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe704baf-25')
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No VIF found with MAC fa:16:3e:27:25:f0, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-03a884de-53af-4707-9e4e-5366673367bb req-a8ebbe51-3be3-46a7-abbd-5f2387ceb22d service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Received event network-changed-be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-03a884de-53af-4707-9e4e-5366673367bb req-a8ebbe51-3be3-46a7-abbd-5f2387ceb22d service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Refreshing instance network info cache due to event network-changed-be704baf-2542-497e-af45-bffa287fc1cd. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-03a884de-53af-4707-9e4e-5366673367bb req-a8ebbe51-3be3-46a7-abbd-5f2387ceb22d service nova] Acquiring lock "refresh_cache-84448e30-982f-4214-a61e-8cc5e122aef3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-03a884de-53af-4707-9e4e-5366673367bb req-a8ebbe51-3be3-46a7-abbd-5f2387ceb22d service nova] Acquired lock "refresh_cache-84448e30-982f-4214-a61e-8cc5e122aef3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.network.neutron [req-03a884de-53af-4707-9e4e-5366673367bb req-a8ebbe51-3be3-46a7-abbd-5f2387ceb22d service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Refreshing network info cache for port be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.network.neutron [req-03a884de-53af-4707-9e4e-5366673367bb req-a8ebbe51-3be3-46a7-abbd-5f2387ceb22d service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Updated VIF entry in instance network info cache for port be704baf-2542-497e-af45-bffa287fc1cd. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG nova.network.neutron [req-03a884de-53af-4707-9e4e-5366673367bb req-a8ebbe51-3be3-46a7-abbd-5f2387ceb22d service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Updating instance_info_cache with network_info: [{"id": "be704baf-2542-497e-af45-bffa287fc1cd", "address": "fa:16:3e:27:25:f0", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe704baf-25", "ovs_interfaceid": "be704baf-2542-497e-af45-bffa287fc1cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-03a884de-53af-4707-9e4e-5366673367bb req-a8ebbe51-3be3-46a7-abbd-5f2387ceb22d service nova] Releasing lock "refresh_cache-84448e30-982f-4214-a61e-8cc5e122aef3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:50:37 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Instance spawned successfully.
Oct 30 10:50:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:38 user nova-compute[74278]: INFO nova.compute.manager [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Took 13.54 seconds to spawn the instance on the hypervisor.
Oct 30 10:50:38 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:50:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:38 user nova-compute[74278]: INFO nova.compute.manager [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Took 14.40 seconds to build instance.
Oct 30 10:50:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5c1e67d4-4b30-4af0-a7de-64819559444c tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.599s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:39 user nova-compute[74278]: DEBUG nova.compute.manager [req-52b8234f-188e-4e11-809b-f96353c2093d req-974d7543-fd88-4bf1-a742-6a37f29c3f7e service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Received event network-vif-plugged-af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-52b8234f-188e-4e11-809b-f96353c2093d req-974d7543-fd88-4bf1-a742-6a37f29c3f7e service nova] Acquiring lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-52b8234f-188e-4e11-809b-f96353c2093d req-974d7543-fd88-4bf1-a742-6a37f29c3f7e service nova] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-52b8234f-188e-4e11-809b-f96353c2093d req-974d7543-fd88-4bf1-a742-6a37f29c3f7e service nova] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:39 user nova-compute[74278]: DEBUG nova.compute.manager [req-52b8234f-188e-4e11-809b-f96353c2093d req-974d7543-fd88-4bf1-a742-6a37f29c3f7e service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] No waiting events found dispatching network-vif-plugged-af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:50:39 user nova-compute[74278]: WARNING nova.compute.manager [req-52b8234f-188e-4e11-809b-f96353c2093d req-974d7543-fd88-4bf1-a742-6a37f29c3f7e service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Received unexpected event network-vif-plugged-af3e969f-e92f-4ae0-ab01-343c78c675b0 for instance with vm_state active and task_state None.
Oct 30 10:50:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:50:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:50:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:50:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:50:41 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Instance spawned successfully.
Oct 30 10:50:41 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Instance spawned successfully.
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: INFO nova.compute.manager [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Took 18.84 seconds to spawn the instance on the hypervisor.
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:50:41 user nova-compute[74278]: INFO nova.compute.manager [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Took 17.24 seconds to spawn the instance on the hypervisor.
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:50:41 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Instance spawned successfully.
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: INFO nova.compute.manager [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Took 20.22 seconds to build instance.
Oct 30 10:50:41 user nova-compute[74278]: INFO nova.compute.manager [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Took 18.79 seconds to build instance.
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-66f1bf76-3921-47be-a6d1-739bdc0259bb req-c9e195be-d1f6-45fc-8ff9-1b058dd6ee06 service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Received event network-vif-plugged-af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-66f1bf76-3921-47be-a6d1-739bdc0259bb req-c9e195be-d1f6-45fc-8ff9-1b058dd6ee06 service nova] Acquiring lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-66f1bf76-3921-47be-a6d1-739bdc0259bb req-c9e195be-d1f6-45fc-8ff9-1b058dd6ee06 service nova] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-66f1bf76-3921-47be-a6d1-739bdc0259bb req-c9e195be-d1f6-45fc-8ff9-1b058dd6ee06 service nova] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-66f1bf76-3921-47be-a6d1-739bdc0259bb req-c9e195be-d1f6-45fc-8ff9-1b058dd6ee06 service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] No waiting events found dispatching network-vif-plugged-af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:50:41 user nova-compute[74278]: WARNING nova.compute.manager [req-66f1bf76-3921-47be-a6d1-739bdc0259bb req-c9e195be-d1f6-45fc-8ff9-1b058dd6ee06 service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Received unexpected event network-vif-plugged-af3e969f-e92f-4ae0-ab01-343c78c675b0 for instance with vm_state active and task_state None.
Oct 30 10:50:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4127992-24b0-47a6-b079-2a1bf6314a67 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.493s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f84f4eb0-1e97-4d82-90ad-a089999bb08d tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "da67673a-dbe6-419f-8547-5ca730f14003" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.976s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:41 user nova-compute[74278]: INFO nova.compute.manager [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Took 12.43 seconds to spawn the instance on the hypervisor.
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:50:41 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Instance spawned successfully.
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:42 user nova-compute[74278]: INFO nova.compute.manager [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Took 13.47 seconds to build instance.
Oct 30 10:50:42 user nova-compute[74278]: INFO nova.compute.manager [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Took 11.36 seconds to spawn the instance on the hypervisor.
Oct 30 10:50:42 user nova-compute[74278]: DEBUG nova.compute.manager [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:50:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-277bb537-6561-46d1-af9c-189bc3d84faa tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.638s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:42 user nova-compute[74278]: INFO nova.compute.manager [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Took 12.50 seconds to build instance.
Oct 30 10:50:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-272b401e-7397-4170-a8ea-94856b66bfc4 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "84448e30-982f-4214-a61e-8cc5e122aef3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.709s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:50:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:47 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:50:47 user nova-compute[74278]: INFO nova.compute.claims [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Claim successful on node user
Oct 30 10:50:47 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:50:47 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:50:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.670s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:50:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:50:47 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:50:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:50:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG nova.policy [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d00cea0f58247448d911d841ef601d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02150e63eb6442ecaf9377edc9036949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:50:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Creating image(s)
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "/opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "/opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "/opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.291s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.239s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk 1073741824" returned: 0 in 0.057s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.255s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:49 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:50:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.440s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:49 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Cannot resize image /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:50:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:50:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Ensure instance console log exists: /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:50:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:49 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Successfully created port: 6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:50:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:50 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Successfully updated port: 6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:50:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "refresh_cache-21d2a8cc-39ee-435e-9936-d1585a9386b7" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquired lock "refresh_cache-21d2a8cc-39ee-435e-9936-d1585a9386b7" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:50 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.compute.manager [req-9d4f76fc-716d-4440-b809-413001dc662c req-30d36916-c9b1-4280-a09d-a8dc02be014b service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Received event network-vif-plugged-79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9d4f76fc-716d-4440-b809-413001dc662c req-30d36916-c9b1-4280-a09d-a8dc02be014b service nova] Acquiring lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9d4f76fc-716d-4440-b809-413001dc662c req-30d36916-c9b1-4280-a09d-a8dc02be014b service nova] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9d4f76fc-716d-4440-b809-413001dc662c req-30d36916-c9b1-4280-a09d-a8dc02be014b service nova] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.compute.manager [req-9d4f76fc-716d-4440-b809-413001dc662c req-30d36916-c9b1-4280-a09d-a8dc02be014b service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] No waiting events found dispatching network-vif-plugged-79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:50:51 user nova-compute[74278]: WARNING nova.compute.manager [req-9d4f76fc-716d-4440-b809-413001dc662c req-30d36916-c9b1-4280-a09d-a8dc02be014b service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Received unexpected event network-vif-plugged-79987a93-94db-41fb-b192-9d8ceaa56407 for instance with vm_state active and task_state None.
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.compute.manager [req-eb9a5c05-c7d0-43cb-9e2f-d25105eae376 req-4f4cc7e8-5ecf-4950-971b-4ae7a946ef43 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Received event network-changed-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.compute.manager [req-eb9a5c05-c7d0-43cb-9e2f-d25105eae376 req-4f4cc7e8-5ecf-4950-971b-4ae7a946ef43 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Refreshing instance network info cache due to event network-changed-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eb9a5c05-c7d0-43cb-9e2f-d25105eae376 req-4f4cc7e8-5ecf-4950-971b-4ae7a946ef43 service nova] Acquiring lock "refresh_cache-21d2a8cc-39ee-435e-9936-d1585a9386b7" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "7264e69a-5781-420d-91b4-ab7d494c40ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Updating instance_info_cache with network_info: [{"id": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "address": "fa:16:3e:d1:b8:2b", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7b9741-ec", "ovs_interfaceid": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Releasing lock "refresh_cache-21d2a8cc-39ee-435e-9936-d1585a9386b7" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Instance network_info: |[{"id": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "address": "fa:16:3e:d1:b8:2b", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7b9741-ec", "ovs_interfaceid": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eb9a5c05-c7d0-43cb-9e2f-d25105eae376 req-4f4cc7e8-5ecf-4950-971b-4ae7a946ef43 service nova] Acquired lock "refresh_cache-21d2a8cc-39ee-435e-9936-d1585a9386b7" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.network.neutron [req-eb9a5c05-c7d0-43cb-9e2f-d25105eae376 req-4f4cc7e8-5ecf-4950-971b-4ae7a946ef43 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Refreshing network info cache for port 6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Start _get_guest_xml network_info=[{"id": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "address": "fa:16:3e:d1:b8:2b", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7b9741-ec", "ovs_interfaceid": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:50:51 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:51 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:50:51 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1476012007',display_name='tempest-VolumesAdminNegativeTest-server-1476012007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1476012007',id=6,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFahvsi9fYH2E4ZTcxa6VqxwmFrIFlj9K/5L6j9PJdKU6YuNH7VNaOxNypG8uf+70SRcFLsf4rhEhtmaPHog1v/30NV3Rk0FqXzGNA1FGl7oXbmaNuKPt0o+Ao+z++Kpg==',key_name='tempest-keypair-594939322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02150e63eb6442ecaf9377edc9036949',ramdisk_id='',reservation_id='r-a09wx02s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-358317095',owner_user_name='tempest-VolumesAdminNegativeTest-358317095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d00cea0f58247448d911d841ef601d2',uuid=21d2a8cc-39ee-435e-9936-d1585a9386b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "address": "fa:16:3e:d1:b8:2b", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7b9741-ec", "ovs_interfaceid": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Converting VIF {"id": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "address": "fa:16:3e:d1:b8:2b", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7b9741-ec", "ovs_interfaceid": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b8:2b,bridge_name='br-int',has_traffic_filtering=True,id=6c7b9741-ec03-46ec-bc59-c3c7ad1bf369,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7b9741-ec') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.objects.instance [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lazy-loading 'pci_devices' on Instance uuid 21d2a8cc-39ee-435e-9936-d1585a9386b7 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:50:52 user nova-compute[74278]:   <uuid>21d2a8cc-39ee-435e-9936-d1585a9386b7</uuid>
Oct 30 10:50:52 user nova-compute[74278]:   <name>instance-00000006</name>
Oct 30 10:50:52 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:50:52 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:50:52 user nova-compute[74278]:   <metadata>
Oct 30 10:50:52 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:50:52 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:50:52 user nova-compute[74278]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1476012007</nova:name>
Oct 30 10:50:52 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:50:51</nova:creationTime>
Oct 30 10:50:52 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:50:52 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:50:52 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:50:52 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:50:52 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:50:52 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:50:52 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:50:52 user nova-compute[74278]:       <nova:owner>
Oct 30 10:50:52 user nova-compute[74278]:         <nova:user uuid="3d00cea0f58247448d911d841ef601d2">tempest-VolumesAdminNegativeTest-358317095-project-member</nova:user>
Oct 30 10:50:52 user nova-compute[74278]:         <nova:project uuid="02150e63eb6442ecaf9377edc9036949">tempest-VolumesAdminNegativeTest-358317095</nova:project>
Oct 30 10:50:52 user nova-compute[74278]:       </nova:owner>
Oct 30 10:50:52 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:50:52 user nova-compute[74278]:       <nova:ports>
Oct 30 10:50:52 user nova-compute[74278]:         <nova:port uuid="6c7b9741-ec03-46ec-bc59-c3c7ad1bf369">
Oct 30 10:50:52 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 10:50:52 user nova-compute[74278]:         </nova:port>
Oct 30 10:50:52 user nova-compute[74278]:       </nova:ports>
Oct 30 10:50:52 user nova-compute[74278]:     </nova:instance>
Oct 30 10:50:52 user nova-compute[74278]:   </metadata>
Oct 30 10:50:52 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:50:52 user nova-compute[74278]:     <system>
Oct 30 10:50:52 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:50:52 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:50:52 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:50:52 user nova-compute[74278]:       <entry name="serial">21d2a8cc-39ee-435e-9936-d1585a9386b7</entry>
Oct 30 10:50:52 user nova-compute[74278]:       <entry name="uuid">21d2a8cc-39ee-435e-9936-d1585a9386b7</entry>
Oct 30 10:50:52 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:50:52 user nova-compute[74278]:     </system>
Oct 30 10:50:52 user nova-compute[74278]:   </sysinfo>
Oct 30 10:50:52 user nova-compute[74278]:   <os>
Oct 30 10:50:52 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:50:52 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:50:52 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:50:52 user nova-compute[74278]:   </os>
Oct 30 10:50:52 user nova-compute[74278]:   <features>
Oct 30 10:50:52 user nova-compute[74278]:     <acpi/>
Oct 30 10:50:52 user nova-compute[74278]:     <apic/>
Oct 30 10:50:52 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:50:52 user nova-compute[74278]:   </features>
Oct 30 10:50:52 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:50:52 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:50:52 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:50:52 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:50:52 user nova-compute[74278]:   </clock>
Oct 30 10:50:52 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:50:52 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:50:52 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:50:52 user nova-compute[74278]:   </cpu>
Oct 30 10:50:52 user nova-compute[74278]:   <devices>
Oct 30 10:50:52 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:50:52 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:50:52 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk"/>
Oct 30 10:50:52 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:50:52 user nova-compute[74278]:     </disk>
Oct 30 10:50:52 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:50:52 user nova-compute[74278]:       <mac address="fa:16:3e:d1:b8:2b"/>
Oct 30 10:50:52 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:52 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:50:52 user nova-compute[74278]:       <target dev="tap6c7b9741-ec"/>
Oct 30 10:50:52 user nova-compute[74278]:     </interface>
Oct 30 10:50:52 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:50:52 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/console.log" append="off"/>
Oct 30 10:50:52 user nova-compute[74278]:     </serial>
Oct 30 10:50:52 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:50:52 user nova-compute[74278]:     <video>
Oct 30 10:50:52 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:52 user nova-compute[74278]:     </video>
Oct 30 10:50:52 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:50:52 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:50:52 user nova-compute[74278]:     </rng>
Oct 30 10:50:52 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:50:52 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:50:52 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:50:52 user nova-compute[74278]:     </memballoon>
Oct 30 10:50:52 user nova-compute[74278]:   </devices>
Oct 30 10:50:52 user nova-compute[74278]: </domain>
Oct 30 10:50:52 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1476012007',display_name='tempest-VolumesAdminNegativeTest-server-1476012007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1476012007',id=6,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFahvsi9fYH2E4ZTcxa6VqxwmFrIFlj9K/5L6j9PJdKU6YuNH7VNaOxNypG8uf+70SRcFLsf4rhEhtmaPHog1v/30NV3Rk0FqXzGNA1FGl7oXbmaNuKPt0o+Ao+z++Kpg==',key_name='tempest-keypair-594939322',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02150e63eb6442ecaf9377edc9036949',ramdisk_id='',reservation_id='r-a09wx02s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-358317095',owner_user_name='tempest-VolumesAdminNegativeTest-358317095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d00cea0f58247448d911d841ef601d2',uuid=21d2a8cc-39ee-435e-9936-d1585a9386b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "address": "fa:16:3e:d1:b8:2b", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7b9741-ec", "ovs_interfaceid": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Converting VIF {"id": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "address": "fa:16:3e:d1:b8:2b", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7b9741-ec", "ovs_interfaceid": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b8:2b,bridge_name='br-int',has_traffic_filtering=True,id=6c7b9741-ec03-46ec-bc59-c3c7ad1bf369,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7b9741-ec') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG os_vif [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b8:2b,bridge_name='br-int',has_traffic_filtering=True,id=6c7b9741-ec03-46ec-bc59-c3c7ad1bf369,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7b9741-ec') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '749e6466-744b-580a-b73e-40ab3d635c30', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c7b9741-ec, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c7b9741-ec, col_values=(('qos', UUID('e06253fd-232f-4907-81dc-d876dd90cf68')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c7b9741-ec, col_values=(('external_ids', {'iface-id': '6c7b9741-ec03-46ec-bc59-c3c7ad1bf369', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:b8:2b', 'vm-uuid': '21d2a8cc-39ee-435e-9936-d1585a9386b7'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:52 user nova-compute[74278]: INFO os_vif [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b8:2b,bridge_name='br-int',has_traffic_filtering=True,id=6c7b9741-ec03-46ec-bc59-c3c7ad1bf369,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7b9741-ec')
Oct 30 10:50:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:50:52 user nova-compute[74278]: INFO nova.compute.claims [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Claim successful on node user
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] No VIF found with MAC fa:16:3e:d1:b8:2b, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:50:52 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.network.neutron [req-eb9a5c05-c7d0-43cb-9e2f-d25105eae376 req-4f4cc7e8-5ecf-4950-971b-4ae7a946ef43 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Updated VIF entry in instance network info cache for port 6c7b9741-ec03-46ec-bc59-c3c7ad1bf369. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.network.neutron [req-eb9a5c05-c7d0-43cb-9e2f-d25105eae376 req-4f4cc7e8-5ecf-4950-971b-4ae7a946ef43 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Updating instance_info_cache with network_info: [{"id": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "address": "fa:16:3e:d1:b8:2b", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7b9741-ec", "ovs_interfaceid": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eb9a5c05-c7d0-43cb-9e2f-d25105eae376 req-4f4cc7e8-5ecf-4950-971b-4ae7a946ef43 service nova] Releasing lock "refresh_cache-21d2a8cc-39ee-435e-9936-d1585a9386b7" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.889s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Received event network-vif-plugged-79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] Acquiring lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] No waiting events found dispatching network-vif-plugged-79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:50:53 user nova-compute[74278]: WARNING nova.compute.manager [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Received unexpected event network-vif-plugged-79987a93-94db-41fb-b192-9d8ceaa56407 for instance with vm_state active and task_state None.
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Received event network-vif-plugged-a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] Acquiring lock "da67673a-dbe6-419f-8547-5ca730f14003-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] Lock "da67673a-dbe6-419f-8547-5ca730f14003-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] Lock "da67673a-dbe6-419f-8547-5ca730f14003-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] No waiting events found dispatching network-vif-plugged-a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:50:53 user nova-compute[74278]: WARNING nova.compute.manager [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Received unexpected event network-vif-plugged-a2d0d57d-3df3-474d-b718-c539fb517f32 for instance with vm_state active and task_state None.
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Received event network-vif-plugged-a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] Acquiring lock "da67673a-dbe6-419f-8547-5ca730f14003-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] Lock "da67673a-dbe6-419f-8547-5ca730f14003-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] Lock "da67673a-dbe6-419f-8547-5ca730f14003-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] No waiting events found dispatching network-vif-plugged-a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:50:53 user nova-compute[74278]: WARNING nova.compute.manager [req-a0249d91-aa9d-4979-8b67-e34da58ef072 req-c5952a1a-eb95-4c4a-8869-1ec07a766e20 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Received unexpected event network-vif-plugged-a2d0d57d-3df3-474d-b718-c539fb517f32 for instance with vm_state active and task_state None.
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:50:53 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.policy [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '180e3b3e92c14c05b1cea8c863c91431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38de12f052e945949c11b4b0603b0610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:50:53 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Creating image(s)
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "/opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "/opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "/opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "ecdda9506238e76d7f45e8481cda3013042ed65b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "ecdda9506238e76d7f45e8481cda3013042ed65b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b.part --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b.part --force-share --output=json" returned: 0 in 0.310s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:54 user nova-compute[74278]: DEBUG nova.virt.images [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] 519e1492-f7ea-41e7-a129-64d3283dfcac was qcow2, converting to raw {{(pid=74278) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 10:50:54 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 10:50:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b.part /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b.converted {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Successfully created port: 101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:50:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b.part /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b.converted" returned: 0 in 0.246s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b.converted --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b.converted --force-share --output=json" returned: 0 in 0.349s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "ecdda9506238e76d7f45e8481cda3013042ed65b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.513s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Successfully updated port: 101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "refresh_cache-7264e69a-5781-420d-91b4-ab7d494c40ca" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquired lock "refresh_cache-7264e69a-5781-420d-91b4-ab7d494c40ca" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b --force-share --output=json" returned: 0 in 0.258s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "ecdda9506238e76d7f45e8481cda3013042ed65b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "ecdda9506238e76d7f45e8481cda3013042ed65b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3da93aa-67bf-425b-b420-db91614b35ff req-02a765f3-158f-4236-9ff8-0efd86bd9c79 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Received event network-changed-101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3da93aa-67bf-425b-b420-db91614b35ff req-02a765f3-158f-4236-9ff8-0efd86bd9c79 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Refreshing instance network info cache due to event network-changed-101928c4-5d7d-49b7-bb17-d730e91d9d50. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3da93aa-67bf-425b-b420-db91614b35ff req-02a765f3-158f-4236-9ff8-0efd86bd9c79 service nova] Acquiring lock "refresh_cache-7264e69a-5781-420d-91b4-ab7d494c40ca" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b --force-share --output=json" returned: 0 in 0.253s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b,backing_fmt=raw /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b,backing_fmt=raw /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk 1073741824" returned: 0 in 0.202s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "ecdda9506238e76d7f45e8481cda3013042ed65b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.459s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Updating instance_info_cache with network_info: [{"id": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "address": "fa:16:3e:5b:71:4c", "network": {"id": "26926697-8d50-436c-bf17-1acc7adfb34b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1400788987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38de12f052e945949c11b4b0603b0610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap101928c4-5d", "ovs_interfaceid": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b --force-share --output=json" returned: 0 in 0.227s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Releasing lock "refresh_cache-7264e69a-5781-420d-91b4-ab7d494c40ca" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Instance network_info: |[{"id": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "address": "fa:16:3e:5b:71:4c", "network": {"id": "26926697-8d50-436c-bf17-1acc7adfb34b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1400788987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38de12f052e945949c11b4b0603b0610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap101928c4-5d", "ovs_interfaceid": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3da93aa-67bf-425b-b420-db91614b35ff req-02a765f3-158f-4236-9ff8-0efd86bd9c79 service nova] Acquired lock "refresh_cache-7264e69a-5781-420d-91b4-ab7d494c40ca" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-b3da93aa-67bf-425b-b420-db91614b35ff req-02a765f3-158f-4236-9ff8-0efd86bd9c79 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Refreshing network info cache for port 101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:50:56 user nova-compute[74278]: INFO nova.compute.claims [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Claim successful on node user
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Cannot resize image /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Ensure instance console log exists: /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Start _get_guest_xml network_info=[{"id": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "address": "fa:16:3e:5b:71:4c", "network": {"id": "26926697-8d50-436c-bf17-1acc7adfb34b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1400788987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38de12f052e945949c11b4b0603b0610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap101928c4-5d", "ovs_interfaceid": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:50:40Z,direct_url=<?>,disk_format='qcow2',id=519e1492-f7ea-41e7-a129-64d3283dfcac,min_disk=0,min_ram=0,name='',owner='de68896215b8490084e45d76198b470b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:50:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'scsi', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '519e1492-f7ea-41e7-a129-64d3283dfcac'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:50:56 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:56 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:50:40Z,direct_url=<?>,disk_format='qcow2',id=519e1492-f7ea-41e7-a129-64d3283dfcac,min_disk=0,min_ram=0,name='',owner='de68896215b8490084e45d76198b470b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:50:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1912750678',display_name='tempest-AttachSCSIVolumeTestJSON-server-1912750678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1912750678',id=7,image_ref='519e1492-f7ea-41e7-a129-64d3283dfcac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChkCjyeOrnpWhsZL4+DzPIAcOVATXVtDFdHnQa7YLdcZKf7zfclQnS87alIuYvLB5dsa2goL8kZOTDXMbdZTGPNpUncTTtlKtGF7NxVshAzceQCZW3X1qjdTko92H6WEA==',key_name='tempest-keypair-1297892646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38de12f052e945949c11b4b0603b0610',ramdisk_id='',reservation_id='r-hpbsldpe',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='519e1492-f7ea-41e7-a129-64d3283dfcac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-70315466',owner_user_name='tempest-AttachSCSIVolumeTestJSON-70315466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='180e3b3e92c14c05b1cea8c863c91431',uuid=7264e69a-5781-420d-91b4-ab7d494c40ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "address": "fa:16:3e:5b:71:4c", "network": {"id": "26926697-8d50-436c-bf17-1acc7adfb34b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1400788987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38de12f052e945949c11b4b0603b0610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap101928c4-5d", "ovs_interfaceid": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Converting VIF {"id": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "address": "fa:16:3e:5b:71:4c", "network": {"id": "26926697-8d50-436c-bf17-1acc7adfb34b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1400788987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38de12f052e945949c11b4b0603b0610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap101928c4-5d", "ovs_interfaceid": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:71:4c,bridge_name='br-int',has_traffic_filtering=True,id=101928c4-5d7d-49b7-bb17-d730e91d9d50,network=Network(26926697-8d50-436c-bf17-1acc7adfb34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap101928c4-5d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.objects.instance [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lazy-loading 'pci_devices' on Instance uuid 7264e69a-5781-420d-91b4-ab7d494c40ca {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:50:56 user nova-compute[74278]:   <uuid>7264e69a-5781-420d-91b4-ab7d494c40ca</uuid>
Oct 30 10:50:56 user nova-compute[74278]:   <name>instance-00000007</name>
Oct 30 10:50:56 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:50:56 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:50:56 user nova-compute[74278]:   <metadata>
Oct 30 10:50:56 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:50:56 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:50:56 user nova-compute[74278]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1912750678</nova:name>
Oct 30 10:50:56 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:50:56</nova:creationTime>
Oct 30 10:50:56 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:50:56 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:50:56 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:50:56 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:50:56 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:50:56 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:50:56 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:50:56 user nova-compute[74278]:       <nova:owner>
Oct 30 10:50:56 user nova-compute[74278]:         <nova:user uuid="180e3b3e92c14c05b1cea8c863c91431">tempest-AttachSCSIVolumeTestJSON-70315466-project-member</nova:user>
Oct 30 10:50:56 user nova-compute[74278]:         <nova:project uuid="38de12f052e945949c11b4b0603b0610">tempest-AttachSCSIVolumeTestJSON-70315466</nova:project>
Oct 30 10:50:56 user nova-compute[74278]:       </nova:owner>
Oct 30 10:50:56 user nova-compute[74278]:       <nova:root type="image" uuid="519e1492-f7ea-41e7-a129-64d3283dfcac"/>
Oct 30 10:50:56 user nova-compute[74278]:       <nova:ports>
Oct 30 10:50:56 user nova-compute[74278]:         <nova:port uuid="101928c4-5d7d-49b7-bb17-d730e91d9d50">
Oct 30 10:50:56 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 30 10:50:56 user nova-compute[74278]:         </nova:port>
Oct 30 10:50:56 user nova-compute[74278]:       </nova:ports>
Oct 30 10:50:56 user nova-compute[74278]:     </nova:instance>
Oct 30 10:50:56 user nova-compute[74278]:   </metadata>
Oct 30 10:50:56 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:50:56 user nova-compute[74278]:     <system>
Oct 30 10:50:56 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:50:56 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:50:56 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:50:56 user nova-compute[74278]:       <entry name="serial">7264e69a-5781-420d-91b4-ab7d494c40ca</entry>
Oct 30 10:50:56 user nova-compute[74278]:       <entry name="uuid">7264e69a-5781-420d-91b4-ab7d494c40ca</entry>
Oct 30 10:50:56 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:50:56 user nova-compute[74278]:     </system>
Oct 30 10:50:56 user nova-compute[74278]:   </sysinfo>
Oct 30 10:50:56 user nova-compute[74278]:   <os>
Oct 30 10:50:56 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:50:56 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:50:56 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:50:56 user nova-compute[74278]:   </os>
Oct 30 10:50:56 user nova-compute[74278]:   <features>
Oct 30 10:50:56 user nova-compute[74278]:     <acpi/>
Oct 30 10:50:56 user nova-compute[74278]:     <apic/>
Oct 30 10:50:56 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:50:56 user nova-compute[74278]:   </features>
Oct 30 10:50:56 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:50:56 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:50:56 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:50:56 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:50:56 user nova-compute[74278]:   </clock>
Oct 30 10:50:56 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:50:56 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:50:56 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:50:56 user nova-compute[74278]:   </cpu>
Oct 30 10:50:56 user nova-compute[74278]:   <devices>
Oct 30 10:50:56 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:50:56 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:50:56 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk"/>
Oct 30 10:50:56 user nova-compute[74278]:       <target dev="sda" bus="scsi"/>
Oct 30 10:50:56 user nova-compute[74278]:       <address type="drive" controller="0" unit="0"/>
Oct 30 10:50:56 user nova-compute[74278]:     </disk>
Oct 30 10:50:56 user nova-compute[74278]:     <disk type="file" device="cdrom">
Oct 30 10:50:56 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none"/>
Oct 30 10:50:56 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk.config"/>
Oct 30 10:50:56 user nova-compute[74278]:       <target dev="sdb" bus="scsi"/>
Oct 30 10:50:56 user nova-compute[74278]:       <address type="drive" controller="0" unit="1"/>
Oct 30 10:50:56 user nova-compute[74278]:     </disk>
Oct 30 10:50:56 user nova-compute[74278]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 30 10:50:56 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:50:56 user nova-compute[74278]:       <mac address="fa:16:3e:5b:71:4c"/>
Oct 30 10:50:56 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:56 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:50:56 user nova-compute[74278]:       <target dev="tap101928c4-5d"/>
Oct 30 10:50:56 user nova-compute[74278]:     </interface>
Oct 30 10:50:56 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:50:56 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/console.log" append="off"/>
Oct 30 10:50:56 user nova-compute[74278]:     </serial>
Oct 30 10:50:56 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:50:56 user nova-compute[74278]:     <video>
Oct 30 10:50:56 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:50:56 user nova-compute[74278]:     </video>
Oct 30 10:50:56 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:50:56 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:50:56 user nova-compute[74278]:     </rng>
Oct 30 10:50:56 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:50:56 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:50:56 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:50:56 user nova-compute[74278]:     </memballoon>
Oct 30 10:50:56 user nova-compute[74278]:   </devices>
Oct 30 10:50:56 user nova-compute[74278]: </domain>
Oct 30 10:50:56 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1912750678',display_name='tempest-AttachSCSIVolumeTestJSON-server-1912750678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1912750678',id=7,image_ref='519e1492-f7ea-41e7-a129-64d3283dfcac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChkCjyeOrnpWhsZL4+DzPIAcOVATXVtDFdHnQa7YLdcZKf7zfclQnS87alIuYvLB5dsa2goL8kZOTDXMbdZTGPNpUncTTtlKtGF7NxVshAzceQCZW3X1qjdTko92H6WEA==',key_name='tempest-keypair-1297892646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38de12f052e945949c11b4b0603b0610',ramdisk_id='',reservation_id='r-hpbsldpe',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='519e1492-f7ea-41e7-a129-64d3283dfcac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-70315466',owner_user_name='tempest-AttachSCSIVolumeTestJSON-70315466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='180e3b3e92c14c05b1cea8c863c91431',uuid=7264e69a-5781-420d-91b4-ab7d494c40ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "address": "fa:16:3e:5b:71:4c", "network": {"id": "26926697-8d50-436c-bf17-1acc7adfb34b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1400788987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38de12f052e945949c11b4b0603b0610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap101928c4-5d", "ovs_interfaceid": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Converting VIF {"id": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "address": "fa:16:3e:5b:71:4c", "network": {"id": "26926697-8d50-436c-bf17-1acc7adfb34b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1400788987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38de12f052e945949c11b4b0603b0610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap101928c4-5d", "ovs_interfaceid": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:71:4c,bridge_name='br-int',has_traffic_filtering=True,id=101928c4-5d7d-49b7-bb17-d730e91d9d50,network=Network(26926697-8d50-436c-bf17-1acc7adfb34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap101928c4-5d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG os_vif [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:71:4c,bridge_name='br-int',has_traffic_filtering=True,id=101928c4-5d7d-49b7-bb17-d730e91d9d50,network=Network(26926697-8d50-436c-bf17-1acc7adfb34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap101928c4-5d') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c67bde9f-c0f6-5682-a5a5-bcd95b77a140', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap101928c4-5d, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap101928c4-5d, col_values=(('qos', UUID('12b6bf2a-3c5a-45ae-87bb-49b5bb5ea518')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap101928c4-5d, col_values=(('external_ids', {'iface-id': '101928c4-5d7d-49b7-bb17-d730e91d9d50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:71:4c', 'vm-uuid': '7264e69a-5781-420d-91b4-ab7d494c40ca'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-b3da93aa-67bf-425b-b420-db91614b35ff req-02a765f3-158f-4236-9ff8-0efd86bd9c79 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Updated VIF entry in instance network info cache for port 101928c4-5d7d-49b7-bb17-d730e91d9d50. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-b3da93aa-67bf-425b-b420-db91614b35ff req-02a765f3-158f-4236-9ff8-0efd86bd9c79 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Updating instance_info_cache with network_info: [{"id": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "address": "fa:16:3e:5b:71:4c", "network": {"id": "26926697-8d50-436c-bf17-1acc7adfb34b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1400788987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38de12f052e945949c11b4b0603b0610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap101928c4-5d", "ovs_interfaceid": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:56 user nova-compute[74278]: INFO os_vif [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:71:4c,bridge_name='br-int',has_traffic_filtering=True,id=101928c4-5d7d-49b7-bb17-d730e91d9d50,network=Network(26926697-8d50-436c-bf17-1acc7adfb34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap101928c4-5d')
Oct 30 10:50:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3da93aa-67bf-425b-b420-db91614b35ff req-02a765f3-158f-4236-9ff8-0efd86bd9c79 service nova] Releasing lock "refresh_cache-7264e69a-5781-420d-91b4-ab7d494c40ca" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] No BDM found with device name sda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:50:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] No VIF found with MAC fa:16:3e:5b:71:4c, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:50:56 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Using config drive
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.803s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:50:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Instance spawned successfully.
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:50:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Creating config drive at /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk.config
Oct 30 10:50:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyl8qaefv {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyl8qaefv" returned: 0 in 0.056s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:50:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.policy [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6b046e419a34ce591eebd5c11332017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253f67cb486c46d1ad6e5ca4b1287893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:50:57 user nova-compute[74278]: INFO nova.compute.manager [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Took 9.25 seconds to spawn the instance on the hypervisor.
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:50:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Creating image(s)
Oct 30 10:50:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:57 user nova-compute[74278]: INFO nova.compute.manager [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Took 10.63 seconds to build instance.
Oct 30 10:50:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0767049e-5131-4098-bb95-d12284456a6c tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.860s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.209s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.253s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk 1073741824" returned: 0 in 0.118s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.384s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Successfully created port: a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.265s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Cannot resize image /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Ensure instance console log exists: /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.007s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:50:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Successfully updated port: a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquired lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3b95171-f382-47e1-bf85-8caae34b0dec req-7ed7a775-1cdd-4a28-8d5c-e12e1b84f503 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-changed-a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3b95171-f382-47e1-bf85-8caae34b0dec req-7ed7a775-1cdd-4a28-8d5c-e12e1b84f503 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Refreshing instance network info cache due to event network-changed-a719761e-73d6-414b-a6d5-68e6b757e402. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3b95171-f382-47e1-bf85-8caae34b0dec req-7ed7a775-1cdd-4a28-8d5c-e12e1b84f503 service nova] Acquiring lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Updating instance_info_cache with network_info: [{"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Releasing lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Instance network_info: |[{"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3b95171-f382-47e1-bf85-8caae34b0dec req-7ed7a775-1cdd-4a28-8d5c-e12e1b84f503 service nova] Acquired lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:50:59 user nova-compute[74278]: DEBUG nova.network.neutron [req-b3b95171-f382-47e1-bf85-8caae34b0dec req-7ed7a775-1cdd-4a28-8d5c-e12e1b84f503 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Refreshing network info cache for port a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Start _get_guest_xml network_info=[{"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:51:00 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:51:00 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1244481291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1244481291',id=8,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hCZm+p9pneLXjvGF3q+uUILN9j75Q8EhDi66gIZTDo8x7vX6mAeb+cwmbpumy2JKJSnUtNn0gun7/lwnmnulLD1nk9wxII3Jt323IfPYgkyT8hzWa5M48LRz07jpuRw==',key_name='tempest-keypair-586447970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='253f67cb486c46d1ad6e5ca4b1287893',ramdisk_id='',reservation_id='r-twe11yrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-112217138',owner_user_name='tempest-TaggedAttachmentsTest-112217138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b046e419a34ce591eebd5c11332017',uuid=0cecb81b-55ae-46de-8f32-433f2ff42bad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converting VIF {"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:42:07,bridge_name='br-int',has_traffic_filtering=True,id=a719761e-73d6-414b-a6d5-68e6b757e402,network=Network(65e6aab6-ebd9-4eeb-9303-21c55651f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa719761e-73') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cecb81b-55ae-46de-8f32-433f2ff42bad {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:51:00 user nova-compute[74278]:   <uuid>0cecb81b-55ae-46de-8f32-433f2ff42bad</uuid>
Oct 30 10:51:00 user nova-compute[74278]:   <name>instance-00000008</name>
Oct 30 10:51:00 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:51:00 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:51:00 user nova-compute[74278]:   <metadata>
Oct 30 10:51:00 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:51:00 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:51:00 user nova-compute[74278]:       <nova:name>tempest-device-tagging-server-1244481291</nova:name>
Oct 30 10:51:00 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:51:00</nova:creationTime>
Oct 30 10:51:00 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:51:00 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:51:00 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:51:00 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:51:00 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:51:00 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:51:00 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:51:00 user nova-compute[74278]:       <nova:owner>
Oct 30 10:51:00 user nova-compute[74278]:         <nova:user uuid="c6b046e419a34ce591eebd5c11332017">tempest-TaggedAttachmentsTest-112217138-project-member</nova:user>
Oct 30 10:51:00 user nova-compute[74278]:         <nova:project uuid="253f67cb486c46d1ad6e5ca4b1287893">tempest-TaggedAttachmentsTest-112217138</nova:project>
Oct 30 10:51:00 user nova-compute[74278]:       </nova:owner>
Oct 30 10:51:00 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:51:00 user nova-compute[74278]:       <nova:ports>
Oct 30 10:51:00 user nova-compute[74278]:         <nova:port uuid="a719761e-73d6-414b-a6d5-68e6b757e402">
Oct 30 10:51:00 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 10:51:00 user nova-compute[74278]:         </nova:port>
Oct 30 10:51:00 user nova-compute[74278]:       </nova:ports>
Oct 30 10:51:00 user nova-compute[74278]:     </nova:instance>
Oct 30 10:51:00 user nova-compute[74278]:   </metadata>
Oct 30 10:51:00 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:51:00 user nova-compute[74278]:     <system>
Oct 30 10:51:00 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:51:00 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:51:00 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:51:00 user nova-compute[74278]:       <entry name="serial">0cecb81b-55ae-46de-8f32-433f2ff42bad</entry>
Oct 30 10:51:00 user nova-compute[74278]:       <entry name="uuid">0cecb81b-55ae-46de-8f32-433f2ff42bad</entry>
Oct 30 10:51:00 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:51:00 user nova-compute[74278]:     </system>
Oct 30 10:51:00 user nova-compute[74278]:   </sysinfo>
Oct 30 10:51:00 user nova-compute[74278]:   <os>
Oct 30 10:51:00 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:51:00 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:51:00 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:51:00 user nova-compute[74278]:   </os>
Oct 30 10:51:00 user nova-compute[74278]:   <features>
Oct 30 10:51:00 user nova-compute[74278]:     <acpi/>
Oct 30 10:51:00 user nova-compute[74278]:     <apic/>
Oct 30 10:51:00 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:51:00 user nova-compute[74278]:   </features>
Oct 30 10:51:00 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:51:00 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:51:00 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:51:00 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:51:00 user nova-compute[74278]:   </clock>
Oct 30 10:51:00 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:51:00 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:51:00 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:51:00 user nova-compute[74278]:   </cpu>
Oct 30 10:51:00 user nova-compute[74278]:   <devices>
Oct 30 10:51:00 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:51:00 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:51:00 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk"/>
Oct 30 10:51:00 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:51:00 user nova-compute[74278]:     </disk>
Oct 30 10:51:00 user nova-compute[74278]:     <disk type="file" device="cdrom">
Oct 30 10:51:00 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none"/>
Oct 30 10:51:00 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk.config"/>
Oct 30 10:51:00 user nova-compute[74278]:       <target dev="hda" bus="ide"/>
Oct 30 10:51:00 user nova-compute[74278]:     </disk>
Oct 30 10:51:00 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:51:00 user nova-compute[74278]:       <mac address="fa:16:3e:ac:42:07"/>
Oct 30 10:51:00 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:51:00 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:51:00 user nova-compute[74278]:       <target dev="tapa719761e-73"/>
Oct 30 10:51:00 user nova-compute[74278]:     </interface>
Oct 30 10:51:00 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:51:00 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/console.log" append="off"/>
Oct 30 10:51:00 user nova-compute[74278]:     </serial>
Oct 30 10:51:00 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:51:00 user nova-compute[74278]:     <video>
Oct 30 10:51:00 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:51:00 user nova-compute[74278]:     </video>
Oct 30 10:51:00 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:51:00 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:51:00 user nova-compute[74278]:     </rng>
Oct 30 10:51:00 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:51:00 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:51:00 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:51:00 user nova-compute[74278]:     </memballoon>
Oct 30 10:51:00 user nova-compute[74278]:   </devices>
Oct 30 10:51:00 user nova-compute[74278]: </domain>
Oct 30 10:51:00 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1244481291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1244481291',id=8,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hCZm+p9pneLXjvGF3q+uUILN9j75Q8EhDi66gIZTDo8x7vX6mAeb+cwmbpumy2JKJSnUtNn0gun7/lwnmnulLD1nk9wxII3Jt323IfPYgkyT8hzWa5M48LRz07jpuRw==',key_name='tempest-keypair-586447970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='253f67cb486c46d1ad6e5ca4b1287893',ramdisk_id='',reservation_id='r-twe11yrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-112217138',owner_user_name='tempest-TaggedAttachmentsTest-112217138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b046e419a34ce591eebd5c11332017',uuid=0cecb81b-55ae-46de-8f32-433f2ff42bad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converting VIF {"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:42:07,bridge_name='br-int',has_traffic_filtering=True,id=a719761e-73d6-414b-a6d5-68e6b757e402,network=Network(65e6aab6-ebd9-4eeb-9303-21c55651f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa719761e-73') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG os_vif [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:42:07,bridge_name='br-int',has_traffic_filtering=True,id=a719761e-73d6-414b-a6d5-68e6b757e402,network=Network(65e6aab6-ebd9-4eeb-9303-21c55651f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa719761e-73') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '811ead90-fed0-5b66-b213-b4e66d78fc9b', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa719761e-73, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa719761e-73, col_values=(('qos', UUID('f54ad5b0-53c8-44d5-a91c-44925bbe88fc')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa719761e-73, col_values=(('external_ids', {'iface-id': 'a719761e-73d6-414b-a6d5-68e6b757e402', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:42:07', 'vm-uuid': '0cecb81b-55ae-46de-8f32-433f2ff42bad'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:00 user nova-compute[74278]: INFO os_vif [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:42:07,bridge_name='br-int',has_traffic_filtering=True,id=a719761e-73d6-414b-a6d5-68e6b757e402,network=Network(65e6aab6-ebd9-4eeb-9303-21c55651f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa719761e-73')
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] No BDM found with device name hda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] No VIF found with MAC fa:16:3e:ac:42:07, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:51:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Using config drive
Oct 30 10:51:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Creating config drive at /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk.config
Oct 30 10:51:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyr9gkclc {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyr9gkclc" returned: 0 in 0.064s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-b3b95171-f382-47e1-bf85-8caae34b0dec req-7ed7a775-1cdd-4a28-8d5c-e12e1b84f503 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Updated VIF entry in instance network info cache for port a719761e-73d6-414b-a6d5-68e6b757e402. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-b3b95171-f382-47e1-bf85-8caae34b0dec req-7ed7a775-1cdd-4a28-8d5c-e12e1b84f503 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Updating instance_info_cache with network_info: [{"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:51:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3b95171-f382-47e1-bf85-8caae34b0dec req-7ed7a775-1cdd-4a28-8d5c-e12e1b84f503 service nova] Releasing lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:51:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-e7e82bf6-6b9a-4a9a-98bb-4a3927f0032f req-32c2b7a7-dbd4-4ab4-981e-a5fdc757a363 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Received event network-vif-plugged-101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e7e82bf6-6b9a-4a9a-98bb-4a3927f0032f req-32c2b7a7-dbd4-4ab4-981e-a5fdc757a363 service nova] Acquiring lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e7e82bf6-6b9a-4a9a-98bb-4a3927f0032f req-32c2b7a7-dbd4-4ab4-981e-a5fdc757a363 service nova] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e7e82bf6-6b9a-4a9a-98bb-4a3927f0032f req-32c2b7a7-dbd4-4ab4-981e-a5fdc757a363 service nova] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-e7e82bf6-6b9a-4a9a-98bb-4a3927f0032f req-32c2b7a7-dbd4-4ab4-981e-a5fdc757a363 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] No waiting events found dispatching network-vif-plugged-101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:51:01 user nova-compute[74278]: WARNING nova.compute.manager [req-e7e82bf6-6b9a-4a9a-98bb-4a3927f0032f req-32c2b7a7-dbd4-4ab4-981e-a5fdc757a363 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Received unexpected event network-vif-plugged-101928c4-5d7d-49b7-bb17-d730e91d9d50 for instance with vm_state building and task_state spawning.
Oct 30 10:51:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-e7e82bf6-6b9a-4a9a-98bb-4a3927f0032f req-32c2b7a7-dbd4-4ab4-981e-a5fdc757a363 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Received event network-vif-plugged-101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e7e82bf6-6b9a-4a9a-98bb-4a3927f0032f req-32c2b7a7-dbd4-4ab4-981e-a5fdc757a363 service nova] Acquiring lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e7e82bf6-6b9a-4a9a-98bb-4a3927f0032f req-32c2b7a7-dbd4-4ab4-981e-a5fdc757a363 service nova] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e7e82bf6-6b9a-4a9a-98bb-4a3927f0032f req-32c2b7a7-dbd4-4ab4-981e-a5fdc757a363 service nova] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-e7e82bf6-6b9a-4a9a-98bb-4a3927f0032f req-32c2b7a7-dbd4-4ab4-981e-a5fdc757a363 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] No waiting events found dispatching network-vif-plugged-101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:51:01 user nova-compute[74278]: WARNING nova.compute.manager [req-e7e82bf6-6b9a-4a9a-98bb-4a3927f0032f req-32c2b7a7-dbd4-4ab4-981e-a5fdc757a363 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Received unexpected event network-vif-plugged-101928c4-5d7d-49b7-bb17-d730e91d9d50 for instance with vm_state building and task_state spawning.
Oct 30 10:51:02 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:51:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:51:02 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Instance spawned successfully.
Oct 30 10:51:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:51:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:02 user nova-compute[74278]: INFO nova.compute.manager [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Took 8.54 seconds to spawn the instance on the hypervisor.
Oct 30 10:51:02 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:51:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:02 user nova-compute[74278]: INFO nova.compute.manager [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Took 10.28 seconds to build instance.
Oct 30 10:51:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0b5970a9-9c1e-4381-b38f-dc4c787ecc9b tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.678s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Acquiring lock "d71474f7-0b91-49e5-b03b-56628ae7823e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:51:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.008s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:51:04 user nova-compute[74278]: INFO nova.compute.claims [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Claim successful on node user
Oct 30 10:51:04 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:51:04 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.904s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:51:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.policy [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5aba23c914c4fc6971b4abf39e8b6a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd40f572025eb4a8d98e01945f7375b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:51:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Instance spawned successfully.
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:51:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Creating image(s)
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Acquiring lock "/opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "/opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "/opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-b81f5e52-ac31-443e-a276-18563aabdaec req-a2badd78-8486-4af3-a850-222864c366fc service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Received event network-vif-plugged-be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b81f5e52-ac31-443e-a276-18563aabdaec req-a2badd78-8486-4af3-a850-222864c366fc service nova] Acquiring lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b81f5e52-ac31-443e-a276-18563aabdaec req-a2badd78-8486-4af3-a850-222864c366fc service nova] Lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b81f5e52-ac31-443e-a276-18563aabdaec req-a2badd78-8486-4af3-a850-222864c366fc service nova] Lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-b81f5e52-ac31-443e-a276-18563aabdaec req-a2badd78-8486-4af3-a850-222864c366fc service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] No waiting events found dispatching network-vif-plugged-be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:51:05 user nova-compute[74278]: WARNING nova.compute.manager [req-b81f5e52-ac31-443e-a276-18563aabdaec req-a2badd78-8486-4af3-a850-222864c366fc service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Received unexpected event network-vif-plugged-be704baf-2542-497e-af45-bffa287fc1cd for instance with vm_state active and task_state None.
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:05 user nova-compute[74278]: INFO nova.compute.manager [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Took 7.80 seconds to spawn the instance on the hypervisor.
Oct 30 10:51:05 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.254s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:05 user nova-compute[74278]: INFO nova.compute.manager [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Took 9.36 seconds to build instance.
Oct 30 10:51:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8d66be3e-8cff-4f23-be0e-4339be585eec tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.573s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.305s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk 1073741824" returned: 0 in 0.065s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.380s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Successfully created port: 4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.302s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Cannot resize image /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Ensure instance console log exists: /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Successfully updated port: 4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Acquiring lock "refresh_cache-d71474f7-0b91-49e5-b03b-56628ae7823e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Acquired lock "refresh_cache-d71474f7-0b91-49e5-b03b-56628ae7823e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-0cb97b9f-d459-4682-a3ac-9e4b98f511ec req-6cbd2f2c-eeed-4ce1-a73e-65718c99bd74 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Received event network-changed-4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-0cb97b9f-d459-4682-a3ac-9e4b98f511ec req-6cbd2f2c-eeed-4ce1-a73e-65718c99bd74 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Refreshing instance network info cache due to event network-changed-4be24152-a25b-4a37-bdc9-93189991dde8. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0cb97b9f-d459-4682-a3ac-9e4b98f511ec req-6cbd2f2c-eeed-4ce1-a73e-65718c99bd74 service nova] Acquiring lock "refresh_cache-d71474f7-0b91-49e5-b03b-56628ae7823e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-fe825e0f-3f37-44eb-a282-944d3e3a6d50 req-2cabbbd7-438f-4d27-8b65-427d2be2db84 service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Received event network-vif-plugged-be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fe825e0f-3f37-44eb-a282-944d3e3a6d50 req-2cabbbd7-438f-4d27-8b65-427d2be2db84 service nova] Acquiring lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fe825e0f-3f37-44eb-a282-944d3e3a6d50 req-2cabbbd7-438f-4d27-8b65-427d2be2db84 service nova] Lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fe825e0f-3f37-44eb-a282-944d3e3a6d50 req-2cabbbd7-438f-4d27-8b65-427d2be2db84 service nova] Lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-fe825e0f-3f37-44eb-a282-944d3e3a6d50 req-2cabbbd7-438f-4d27-8b65-427d2be2db84 service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] No waiting events found dispatching network-vif-plugged-be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:51:07 user nova-compute[74278]: WARNING nova.compute.manager [req-fe825e0f-3f37-44eb-a282-944d3e3a6d50 req-2cabbbd7-438f-4d27-8b65-427d2be2db84 service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Received unexpected event network-vif-plugged-be704baf-2542-497e-af45-bffa287fc1cd for instance with vm_state active and task_state None.
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Updating instance_info_cache with network_info: [{"id": "4be24152-a25b-4a37-bdc9-93189991dde8", "address": "fa:16:3e:81:3f:49", "network": {"id": "c6818f86-d1aa-4736-afbc-f516531a4a23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-83968978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40f572025eb4a8d98e01945f7375b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be24152-a2", "ovs_interfaceid": "4be24152-a25b-4a37-bdc9-93189991dde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Releasing lock "refresh_cache-d71474f7-0b91-49e5-b03b-56628ae7823e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Instance network_info: |[{"id": "4be24152-a25b-4a37-bdc9-93189991dde8", "address": "fa:16:3e:81:3f:49", "network": {"id": "c6818f86-d1aa-4736-afbc-f516531a4a23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-83968978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40f572025eb4a8d98e01945f7375b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be24152-a2", "ovs_interfaceid": "4be24152-a25b-4a37-bdc9-93189991dde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0cb97b9f-d459-4682-a3ac-9e4b98f511ec req-6cbd2f2c-eeed-4ce1-a73e-65718c99bd74 service nova] Acquired lock "refresh_cache-d71474f7-0b91-49e5-b03b-56628ae7823e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.network.neutron [req-0cb97b9f-d459-4682-a3ac-9e4b98f511ec req-6cbd2f2c-eeed-4ce1-a73e-65718c99bd74 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Refreshing network info cache for port 4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Start _get_guest_xml network_info=[{"id": "4be24152-a25b-4a37-bdc9-93189991dde8", "address": "fa:16:3e:81:3f:49", "network": {"id": "c6818f86-d1aa-4736-afbc-f516531a4a23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-83968978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40f572025eb4a8d98e01945f7375b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be24152-a2", "ovs_interfaceid": "4be24152-a25b-4a37-bdc9-93189991dde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:51:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:51:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:51:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:51:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-965192881',display_name='tempest-VolumesAssistedSnapshotsTest-server-965192881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-965192881',id=9,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKJlMZvxXk4JAmeaCcAPCxvG+w0EiJIPbgaVknuhia7ZOpLHtsXajwPTjXQ68UxvMBzeyBWbNOHgU2EdkwHX5Kod5roXgDcjlCgazZvjv4M50n7Ou2o09alvs/SvdFiLA==',key_name='tempest-keypair-1172737879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d40f572025eb4a8d98e01945f7375b34',ramdisk_id='',reservation_id='r-gj0ogx7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1038709422',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1038709422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:51:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5aba23c914c4fc6971b4abf39e8b6a9',uuid=d71474f7-0b91-49e5-b03b-56628ae7823e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4be24152-a25b-4a37-bdc9-93189991dde8", "address": "fa:16:3e:81:3f:49", "network": {"id": "c6818f86-d1aa-4736-afbc-f516531a4a23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-83968978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40f572025eb4a8d98e01945f7375b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be24152-a2", "ovs_interfaceid": "4be24152-a25b-4a37-bdc9-93189991dde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Converting VIF {"id": "4be24152-a25b-4a37-bdc9-93189991dde8", "address": "fa:16:3e:81:3f:49", "network": {"id": "c6818f86-d1aa-4736-afbc-f516531a4a23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-83968978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40f572025eb4a8d98e01945f7375b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be24152-a2", "ovs_interfaceid": "4be24152-a25b-4a37-bdc9-93189991dde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=4be24152-a25b-4a37-bdc9-93189991dde8,network=Network(c6818f86-d1aa-4736-afbc-f516531a4a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be24152-a2') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG nova.objects.instance [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lazy-loading 'pci_devices' on Instance uuid d71474f7-0b91-49e5-b03b-56628ae7823e {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:51:08 user nova-compute[74278]:   <uuid>d71474f7-0b91-49e5-b03b-56628ae7823e</uuid>
Oct 30 10:51:08 user nova-compute[74278]:   <name>instance-00000009</name>
Oct 30 10:51:08 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:51:08 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:51:08 user nova-compute[74278]:   <metadata>
Oct 30 10:51:08 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:51:08 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:51:08 user nova-compute[74278]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-965192881</nova:name>
Oct 30 10:51:08 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:51:07</nova:creationTime>
Oct 30 10:51:08 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:51:08 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:51:08 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:51:08 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:51:08 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:51:08 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:51:08 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:51:08 user nova-compute[74278]:       <nova:owner>
Oct 30 10:51:08 user nova-compute[74278]:         <nova:user uuid="a5aba23c914c4fc6971b4abf39e8b6a9">tempest-VolumesAssistedSnapshotsTest-1038709422-project-member</nova:user>
Oct 30 10:51:08 user nova-compute[74278]:         <nova:project uuid="d40f572025eb4a8d98e01945f7375b34">tempest-VolumesAssistedSnapshotsTest-1038709422</nova:project>
Oct 30 10:51:08 user nova-compute[74278]:       </nova:owner>
Oct 30 10:51:08 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:51:08 user nova-compute[74278]:       <nova:ports>
Oct 30 10:51:08 user nova-compute[74278]:         <nova:port uuid="4be24152-a25b-4a37-bdc9-93189991dde8">
Oct 30 10:51:08 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 10:51:08 user nova-compute[74278]:         </nova:port>
Oct 30 10:51:08 user nova-compute[74278]:       </nova:ports>
Oct 30 10:51:08 user nova-compute[74278]:     </nova:instance>
Oct 30 10:51:08 user nova-compute[74278]:   </metadata>
Oct 30 10:51:08 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:51:08 user nova-compute[74278]:     <system>
Oct 30 10:51:08 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:51:08 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:51:08 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:51:08 user nova-compute[74278]:       <entry name="serial">d71474f7-0b91-49e5-b03b-56628ae7823e</entry>
Oct 30 10:51:08 user nova-compute[74278]:       <entry name="uuid">d71474f7-0b91-49e5-b03b-56628ae7823e</entry>
Oct 30 10:51:08 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:51:08 user nova-compute[74278]:     </system>
Oct 30 10:51:08 user nova-compute[74278]:   </sysinfo>
Oct 30 10:51:08 user nova-compute[74278]:   <os>
Oct 30 10:51:08 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:51:08 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:51:08 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:51:08 user nova-compute[74278]:   </os>
Oct 30 10:51:08 user nova-compute[74278]:   <features>
Oct 30 10:51:08 user nova-compute[74278]:     <acpi/>
Oct 30 10:51:08 user nova-compute[74278]:     <apic/>
Oct 30 10:51:08 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:51:08 user nova-compute[74278]:   </features>
Oct 30 10:51:08 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:51:08 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:51:08 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:51:08 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:51:08 user nova-compute[74278]:   </clock>
Oct 30 10:51:08 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:51:08 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:51:08 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:51:08 user nova-compute[74278]:   </cpu>
Oct 30 10:51:08 user nova-compute[74278]:   <devices>
Oct 30 10:51:08 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:51:08 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:51:08 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk"/>
Oct 30 10:51:08 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:51:08 user nova-compute[74278]:     </disk>
Oct 30 10:51:08 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:51:08 user nova-compute[74278]:       <mac address="fa:16:3e:81:3f:49"/>
Oct 30 10:51:08 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:51:08 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:51:08 user nova-compute[74278]:       <target dev="tap4be24152-a2"/>
Oct 30 10:51:08 user nova-compute[74278]:     </interface>
Oct 30 10:51:08 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:51:08 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/console.log" append="off"/>
Oct 30 10:51:08 user nova-compute[74278]:     </serial>
Oct 30 10:51:08 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:51:08 user nova-compute[74278]:     <video>
Oct 30 10:51:08 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:51:08 user nova-compute[74278]:     </video>
Oct 30 10:51:08 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:51:08 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:51:08 user nova-compute[74278]:     </rng>
Oct 30 10:51:08 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:51:08 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:51:08 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:51:08 user nova-compute[74278]:     </memballoon>
Oct 30 10:51:08 user nova-compute[74278]:   </devices>
Oct 30 10:51:08 user nova-compute[74278]: </domain>
Oct 30 10:51:08 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:51:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-965192881',display_name='tempest-VolumesAssistedSnapshotsTest-server-965192881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-965192881',id=9,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKJlMZvxXk4JAmeaCcAPCxvG+w0EiJIPbgaVknuhia7ZOpLHtsXajwPTjXQ68UxvMBzeyBWbNOHgU2EdkwHX5Kod5roXgDcjlCgazZvjv4M50n7Ou2o09alvs/SvdFiLA==',key_name='tempest-keypair-1172737879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d40f572025eb4a8d98e01945f7375b34',ramdisk_id='',reservation_id='r-gj0ogx7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1038709422',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1038709422-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:51:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5aba23c914c4fc6971b4abf39e8b6a9',uuid=d71474f7-0b91-49e5-b03b-56628ae7823e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4be24152-a25b-4a37-bdc9-93189991dde8", "address": "fa:16:3e:81:3f:49", "network": {"id": "c6818f86-d1aa-4736-afbc-f516531a4a23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-83968978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40f572025eb4a8d98e01945f7375b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be24152-a2", "ovs_interfaceid": "4be24152-a25b-4a37-bdc9-93189991dde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Converting VIF {"id": "4be24152-a25b-4a37-bdc9-93189991dde8", "address": "fa:16:3e:81:3f:49", "network": {"id": "c6818f86-d1aa-4736-afbc-f516531a4a23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-83968978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40f572025eb4a8d98e01945f7375b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be24152-a2", "ovs_interfaceid": "4be24152-a25b-4a37-bdc9-93189991dde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=4be24152-a25b-4a37-bdc9-93189991dde8,network=Network(c6818f86-d1aa-4736-afbc-f516531a4a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be24152-a2') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG os_vif [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=4be24152-a25b-4a37-bdc9-93189991dde8,network=Network(c6818f86-d1aa-4736-afbc-f516531a4a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be24152-a2') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4d9c708-a449-5292-b9bb-c53face4b2a4', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4be24152-a2, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4be24152-a2, col_values=(('qos', UUID('bd7365c3-39e0-45a3-a0cd-ebc88854794b')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4be24152-a2, col_values=(('external_ids', {'iface-id': '4be24152-a25b-4a37-bdc9-93189991dde8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:3f:49', 'vm-uuid': 'd71474f7-0b91-49e5-b03b-56628ae7823e'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:08 user nova-compute[74278]: INFO os_vif [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=4be24152-a25b-4a37-bdc9-93189991dde8,network=Network(c6818f86-d1aa-4736-afbc-f516531a4a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be24152-a2')
Oct 30 10:51:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] No VIF found with MAC fa:16:3e:81:3f:49, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG nova.network.neutron [req-0cb97b9f-d459-4682-a3ac-9e4b98f511ec req-6cbd2f2c-eeed-4ce1-a73e-65718c99bd74 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Updated VIF entry in instance network info cache for port 4be24152-a25b-4a37-bdc9-93189991dde8. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG nova.network.neutron [req-0cb97b9f-d459-4682-a3ac-9e4b98f511ec req-6cbd2f2c-eeed-4ce1-a73e-65718c99bd74 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Updating instance_info_cache with network_info: [{"id": "4be24152-a25b-4a37-bdc9-93189991dde8", "address": "fa:16:3e:81:3f:49", "network": {"id": "c6818f86-d1aa-4736-afbc-f516531a4a23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-83968978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40f572025eb4a8d98e01945f7375b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be24152-a2", "ovs_interfaceid": "4be24152-a25b-4a37-bdc9-93189991dde8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:51:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0cb97b9f-d459-4682-a3ac-9e4b98f511ec req-6cbd2f2c-eeed-4ce1-a73e-65718c99bd74 service nova] Releasing lock "refresh_cache-d71474f7-0b91-49e5-b03b-56628ae7823e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:51:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-acc71948-015f-4907-aeb4-89ae2491ebbd req-01648d90-108e-472c-ac1a-bbf30e60ee71 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Received event network-vif-plugged-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-acc71948-015f-4907-aeb4-89ae2491ebbd req-01648d90-108e-472c-ac1a-bbf30e60ee71 service nova] Acquiring lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-acc71948-015f-4907-aeb4-89ae2491ebbd req-01648d90-108e-472c-ac1a-bbf30e60ee71 service nova] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-acc71948-015f-4907-aeb4-89ae2491ebbd req-01648d90-108e-472c-ac1a-bbf30e60ee71 service nova] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-acc71948-015f-4907-aeb4-89ae2491ebbd req-01648d90-108e-472c-ac1a-bbf30e60ee71 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] No waiting events found dispatching network-vif-plugged-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:51:12 user nova-compute[74278]: WARNING nova.compute.manager [req-acc71948-015f-4907-aeb4-89ae2491ebbd req-01648d90-108e-472c-ac1a-bbf30e60ee71 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Received unexpected event network-vif-plugged-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 for instance with vm_state active and task_state None.
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:51:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Instance spawned successfully.
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:13 user nova-compute[74278]: INFO nova.compute.manager [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Took 7.94 seconds to spawn the instance on the hypervisor.
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] There are 0 instances to clean {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74278) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 10:51:13 user nova-compute[74278]: INFO nova.compute.manager [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Took 9.42 seconds to build instance.
Oct 30 10:51:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5a6f8b8-a75d-442b-a447-24c77710654c tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.555s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Received event network-vif-plugged-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] Acquiring lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] No waiting events found dispatching network-vif-plugged-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:51:14 user nova-compute[74278]: WARNING nova.compute.manager [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Received unexpected event network-vif-plugged-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 for instance with vm_state active and task_state None.
Oct 30 10:51:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Received event network-vif-plugged-4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] Acquiring lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] No waiting events found dispatching network-vif-plugged-4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:51:14 user nova-compute[74278]: WARNING nova.compute.manager [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Received unexpected event network-vif-plugged-4be24152-a25b-4a37-bdc9-93189991dde8 for instance with vm_state active and task_state None.
Oct 30 10:51:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Received event network-vif-plugged-4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] Acquiring lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] No waiting events found dispatching network-vif-plugged-4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:51:14 user nova-compute[74278]: WARNING nova.compute.manager [req-3367ab9d-d98a-4df5-a194-6d27bd17724e req-5ce4673e-c9fa-4236-89f8-55b0e391bc5e service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Received unexpected event network-vif-plugged-4be24152-a25b-4a37-bdc9-93189991dde8 for instance with vm_state active and task_state None.
Oct 30 10:51:15 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:51:15 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:51:16 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:51:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:51:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 10:51:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-d4d34729-e6b8-4f5c-aed8-b6f200287457" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:51:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-d4d34729-e6b8-4f5c-aed8-b6f200287457" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:51:16 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 10:51:16 user nova-compute[74278]: DEBUG nova.objects.instance [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lazy-loading 'info_cache' on Instance uuid d4d34729-e6b8-4f5c-aed8-b6f200287457 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Updating instance_info_cache with network_info: [{"id": "79987a93-94db-41fb-b192-9d8ceaa56407", "address": "fa:16:3e:8c:9d:d4", "network": {"id": "e5fe74b4-ac3e-43a1-94b5-80493fdab5c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-349284564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "180c08739aa54f4f92350dd647aa73e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79987a93-94", "ovs_interfaceid": "79987a93-94db-41fb-b192-9d8ceaa56407", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-d4d34729-e6b8-4f5c-aed8-b6f200287457" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-c3d8a1b1-106d-4b08-96cd-a631e5faeba3 req-d64b995d-7c57-4c3d-b005-1b5e1c576813 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c3d8a1b1-106d-4b08-96cd-a631e5faeba3 req-d64b995d-7c57-4c3d-b005-1b5e1c576813 service nova] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c3d8a1b1-106d-4b08-96cd-a631e5faeba3 req-d64b995d-7c57-4c3d-b005-1b5e1c576813 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c3d8a1b1-106d-4b08-96cd-a631e5faeba3 req-d64b995d-7c57-4c3d-b005-1b5e1c576813 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-c3d8a1b1-106d-4b08-96cd-a631e5faeba3 req-d64b995d-7c57-4c3d-b005-1b5e1c576813 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] No waiting events found dispatching network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:51:17 user nova-compute[74278]: WARNING nova.compute.manager [req-c3d8a1b1-106d-4b08-96cd-a631e5faeba3 req-d64b995d-7c57-4c3d-b005-1b5e1c576813 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received unexpected event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 for instance with vm_state active and task_state None.
Oct 30 10:51:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] No waiting events found dispatching network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:51:19 user nova-compute[74278]: WARNING nova.compute.manager [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received unexpected event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 for instance with vm_state active and task_state None.
Oct 30 10:51:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-vif-plugged-a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] No waiting events found dispatching network-vif-plugged-a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:51:19 user nova-compute[74278]: WARNING nova.compute.manager [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received unexpected event network-vif-plugged-a719761e-73d6-414b-a6d5-68e6b757e402 for instance with vm_state active and task_state None.
Oct 30 10:51:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-vif-plugged-a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] No waiting events found dispatching network-vif-plugged-a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:51:19 user nova-compute[74278]: WARNING nova.compute.manager [req-1a47cd84-676b-4eb8-8592-2d9a7baf5c3a req-b7138f18-990e-49c9-ae03-2bd1b9ee82cb service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received unexpected event network-vif-plugged-a719761e-73d6-414b-a6d5-68e6b757e402 for instance with vm_state active and task_state None.
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:51:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:51:22 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:51:22 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7379MB free_disk=25.393901824951172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance d4d34729-e6b8-4f5c-aed8-b6f200287457 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 55cf7cd9-4e0b-4caa-874e-4963079e3b10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 84448e30-982f-4214-a61e-8cc5e122aef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 7264e69a-5781-420d-91b4-ab7d494c40ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0cecb81b-55ae-46de-8f32-433f2ff42bad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance d71474f7-0b91-49e5-b03b-56628ae7823e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing inventories for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating ProviderTree inventory for provider ce405684-67ab-45d9-bc83-6af4903bfb15 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 10:51:22 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating inventory in ProviderTree for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 10:51:23 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing aggregate associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, aggregates: None {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 10:51:23 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing trait associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 10:51:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:23 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:51:23 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:51:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:23 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:51:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.187s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:51:24 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:51:24 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:51:24 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:51:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:51:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:51:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 10:51:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 10:51:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 10:51:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "3c26a595-b269-44b0-bf02-43b6b768183e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:01 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:52:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:01 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:52:01 user nova-compute[74278]: INFO nova.compute.claims [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Claim successful on node user
Oct 30 10:52:02 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:52:02 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:52:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:02 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:52:02 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:52:02 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:52:02 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:52:02 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:52:02 user nova-compute[74278]: INFO nova.virt.block_device [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Booting with volume 3b4bf1cf-571a-47d2-b86c-75e5e4210b47 at /dev/vda
Oct 30 10:52:02 user nova-compute[74278]: DEBUG nova.policy [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca01d5bb5fed4d10a71dc75a9b84cce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede4e1a736e44d34b20ff87b3080c98f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:52:02 user nova-compute[74278]: DEBUG os_brick.utils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:52:02 user nova-compute[74278]: INFO oslo.privsep.daemon [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmphgc8nkd4/privsep.sock']
Oct 30 10:52:02 user sudo[85482]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmphgc8nkd4/privsep.sock
Oct 30 10:52:02 user sudo[85482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 30 10:52:02 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Successfully created port: edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:52:03 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Successfully created port: 64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:52:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 10:52:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 10:52:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 10:52:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:03 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Successfully created port: 67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:52:03 user sudo[85482]: pam_unix(sudo:session): session closed for user root
Oct 30 10:52:03 user nova-compute[74278]: INFO oslo.privsep.daemon [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Spawned new privsep daemon via rootwrap
Oct 30 10:52:03 user nova-compute[74278]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 30 10:52:03 user nova-compute[74278]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 30 10:52:03 user nova-compute[74278]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 30 10:52:03 user nova-compute[74278]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85487
Oct 30 10:52:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a44099-e81c-4c8c-9509-6055800bf91b]: (2,) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[246961a5-9163-451c-a6fa-d22e1ca3c98d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:04 user nova-compute[74278]: WARNING os_brick.initiator.connectors.nvmeof [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a7b64f-09a8-4988-a287-c57921dcfb8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3c2ae2-0ffd-43e5-9fb8-a5254a245424]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[16531e69-3c40-46c3-9dcc-54cc20e31bcb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:04 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:52:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40ea813-76d0-4154-8a0c-176523e7d679]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG os_brick.utils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] <== get_connector_properties: return (1843ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating existing volume attachment record: 62b350f8-461c-4b9d-b8a1-1ed879d05730 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:52:04 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Successfully created port: 65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:52:05 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Successfully created port: c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:52:05 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Successfully updated port: edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:52:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-05b723cc-a8d3-46ef-a0ab-05d3e98435cf req-5ff07237-8647-4e20-b568-27ba6aafcbe9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-changed-edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-05b723cc-a8d3-46ef-a0ab-05d3e98435cf req-5ff07237-8647-4e20-b568-27ba6aafcbe9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing instance network info cache due to event network-changed-edff675c-acda-4742-ad07-9d0467793110. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-05b723cc-a8d3-46ef-a0ab-05d3e98435cf req-5ff07237-8647-4e20-b568-27ba6aafcbe9 service nova] Acquiring lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-05b723cc-a8d3-46ef-a0ab-05d3e98435cf req-5ff07237-8647-4e20-b568-27ba6aafcbe9 service nova] Acquired lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:05 user nova-compute[74278]: DEBUG nova.network.neutron [req-05b723cc-a8d3-46ef-a0ab-05d3e98435cf req-5ff07237-8647-4e20-b568-27ba6aafcbe9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing network info cache for port edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:05 user nova-compute[74278]: DEBUG nova.network.neutron [req-05b723cc-a8d3-46ef-a0ab-05d3e98435cf req-5ff07237-8647-4e20-b568-27ba6aafcbe9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:52:06 user nova-compute[74278]: DEBUG nova.network.neutron [req-05b723cc-a8d3-46ef-a0ab-05d3e98435cf req-5ff07237-8647-4e20-b568-27ba6aafcbe9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-05b723cc-a8d3-46ef-a0ab-05d3e98435cf req-5ff07237-8647-4e20-b568-27ba6aafcbe9 service nova] Releasing lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Successfully updated port: 04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:52:07 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Successfully updated port: f86eed54-e62f-496b-9a5f-ed15fb77dd3c {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:52:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-changed-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing instance network info cache due to event network-changed-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] Acquiring lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] Acquired lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:07 user nova-compute[74278]: DEBUG nova.network.neutron [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing network info cache for port 04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:07 user nova-compute[74278]: DEBUG nova.network.neutron [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG nova.network.neutron [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] Releasing lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-changed-f86eed54-e62f-496b-9a5f-ed15fb77dd3c {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing instance network info cache due to event network-changed-f86eed54-e62f-496b-9a5f-ed15fb77dd3c. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] Acquiring lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] Acquired lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG nova.network.neutron [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing network info cache for port f86eed54-e62f-496b-9a5f-ed15fb77dd3c {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG nova.network.neutron [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Successfully updated port: 64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG nova.network.neutron [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8671a039-8e09-4b42-bf05-e99f8bb56d5e req-f95d693a-89db-4d47-8913-e694b59e09d2 service nova] Releasing lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:09 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Successfully updated port: 67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:52:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-changed-64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing instance network info cache due to event network-changed-64a18b70-db46-4f6e-825f-402681eca643. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] Acquiring lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] Acquired lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:09 user nova-compute[74278]: DEBUG nova.network.neutron [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing network info cache for port 64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:10 user nova-compute[74278]: DEBUG nova.network.neutron [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:52:10 user nova-compute[74278]: DEBUG nova.network.neutron [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] Releasing lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-changed-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing instance network info cache due to event network-changed-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] Acquiring lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] Acquired lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:10 user nova-compute[74278]: DEBUG nova.network.neutron [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing network info cache for port 67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:10 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Successfully updated port: 65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:52:10 user nova-compute[74278]: DEBUG nova.network.neutron [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:52:11 user nova-compute[74278]: DEBUG nova.network.neutron [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-39ee40ee-34f0-4b5f-b7c3-a9f1884d9c8e req-c478a187-d97a-4728-a2e4-819af9bd2974 service nova] Releasing lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:11 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Successfully updated port: c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:52:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquired lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:11 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:52:11 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:52:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-changed-65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing instance network info cache due to event network-changed-65829325-bf17-46c2-b8b3-8eba21130ce1. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] Acquiring lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG nova.compute.manager [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [{"id": "edff675c-acda-4742-ad07-9d0467793110", "address": "fa:16:3e:b3:fb:38", "network": {"id": "19ff6d4c-75b3-458e-b3de-078a13b43272", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-53728059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff675c-ac", "ovs_interfaceid": "edff675c-acda-4742-ad07-9d0467793110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Releasing lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Instance network_info: |[{"id": "edff675c-acda-4742-ad07-9d0467793110", "address": "fa:16:3e:b3:fb:38", "network": {"id": "19ff6d4c-75b3-458e-b3de-078a13b43272", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-53728059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff675c-ac", "ovs_interfaceid": "edff675c-acda-4742-ad07-9d0467793110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] Acquired lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing network info cache for port 65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:14 user nova-compute[74278]: INFO nova.compute.manager [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] instance snapshotting
Oct 30 10:52:14 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Beginning live snapshot process
Oct 30 10:52:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG nova.compute.manager [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json -f qcow2 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:52:14 user nova-compute[74278]: INFO nova.compute.claims [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Claim successful on node user
Oct 30 10:52:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updated VIF entry in instance network info cache for port 65829325-bf17-46c2-b8b3-8eba21130ce1. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [{"id": "edff675c-acda-4742-ad07-9d0467793110", "address": "fa:16:3e:b3:fb:38", "network": {"id": "19ff6d4c-75b3-458e-b3de-078a13b43272", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-53728059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff675c-ac", "ovs_interfaceid": "edff675c-acda-4742-ad07-9d0467793110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] Releasing lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-changed-c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing instance network info cache due to event network-changed-c65bf1e5-c95f-473e-9452-fc6ff873d709. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] Acquiring lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] Acquired lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing network info cache for port c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json -f qcow2 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json -f qcow2" returned: 0 in 0.219s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.187s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_u6bragx/5ef9b8cb45b4417186a74ca256f9b727.delta 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_u6bragx/5ef9b8cb45b4417186a74ca256f9b727.delta 1073741824" returned: 0 in 0.050s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:15 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 30 10:52:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74278) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 30 10:52:15 user nova-compute[74278]: INFO nova.virt.libvirt.host [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] UEFI support detected
Oct 30 10:52:15 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.654s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG nova.network.neutron [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:52:15 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:52:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG nova.policy [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa0d70bee1b64b939678aec53d77c0fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad83f3fea7fc4f308278ab8be165e86b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:52:15 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Creating image(s)
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "/opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "/opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updated VIF entry in instance network info cache for port c65bf1e5-c95f-473e-9452-fc6ff873d709. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [{"id": "edff675c-acda-4742-ad07-9d0467793110", "address": "fa:16:3e:b3:fb:38", "network": {"id": "19ff6d4c-75b3-458e-b3de-078a13b43272", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-53728059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff675c-ac", "ovs_interfaceid": "edff675c-acda-4742-ad07-9d0467793110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-56ebe65b-e20b-40bf-ad9f-6720026d118c req-fc395800-9752-48b8-a818-ddd9342cfae9 service nova] Releasing lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.201s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] COPY block job progress, current cursor: 655360 final cursor: 75497472 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.217s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk 1073741824" returned: 0 in 0.063s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Cannot resize image /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Ensure instance console log exists: /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:52:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 10:52:16 user nova-compute[74278]: DEBUG nova.network.neutron [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Successfully created port: 43613540-5fba-41ad-8378-9f02b51dbf04 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 10:52:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_u6bragx/5ef9b8cb45b4417186a74ca256f9b727.delta /opt/stack/data/nova/instances/snapshots/tmp_u6bragx/5ef9b8cb45b4417186a74ca256f9b727 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "d4d34729-e6b8-4f5c-aed8-b6f200287457" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_u6bragx/5ef9b8cb45b4417186a74ca256f9b727.delta /opt/stack/data/nova/instances/snapshots/tmp_u6bragx/5ef9b8cb45b4417186a74ca256f9b727" returned: 0 in 0.461s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:17 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Snapshot extracted, beginning image upload
Oct 30 10:52:17 user nova-compute[74278]: DEBUG nova.objects.instance [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lazy-loading 'flavor' on Instance uuid d4d34729-e6b8-4f5c-aed8-b6f200287457 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Successfully updated port: 43613540-5fba-41ad-8378-9f02b51dbf04 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "refresh_cache-3d06fffa-bbb3-4853-8fad-b2e3ea89607c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquired lock "refresh_cache-3d06fffa-bbb3-4853-8fad-b2e3ea89607c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-6738a77d-d530-441d-9dc3-5aa1e7496e63 req-0c2c1e2b-ca25-41c3-9342-db5084b3856d service nova] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Received event network-changed-43613540-5fba-41ad-8378-9f02b51dbf04 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-6738a77d-d530-441d-9dc3-5aa1e7496e63 req-0c2c1e2b-ca25-41c3-9342-db5084b3856d service nova] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Refreshing instance network info cache due to event network-changed-43613540-5fba-41ad-8378-9f02b51dbf04. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6738a77d-d530-441d-9dc3-5aa1e7496e63 req-0c2c1e2b-ca25-41c3-9342-db5084b3856d service nova] Acquiring lock "refresh_cache-3d06fffa-bbb3-4853-8fad-b2e3ea89607c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "d4d34729-e6b8-4f5c-aed8-b6f200287457" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:17 user nova-compute[74278]: INFO nova.compute.manager [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Attaching volume a1e0d5b7-30ce-446d-a424-f19092689a97 to /dev/vdb
Oct 30 10:52:17 user nova-compute[74278]: DEBUG os_brick.utils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f688e48-e320-4b86-90ce-b0cd62e7e594]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ef10a8-82ab-4d5a-aaf0-2a38371de0c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[da979c9f-088a-4567-be54-aac43c97a2e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f765c2d-04ee-4171-a924-bd4ca78efc05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:17 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:52:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df47575-e587-4345-8757-8fbf550f7b33]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG os_brick.utils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:52:17 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Updating existing volume attachment record: 3a81cdf5-a6c2-405c-adc8-4d7b65544ed8 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Updating instance_info_cache with network_info: [{"id": "43613540-5fba-41ad-8378-9f02b51dbf04", "address": "fa:16:3e:89:ed:59", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43613540-5f", "ovs_interfaceid": "43613540-5fba-41ad-8378-9f02b51dbf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Releasing lock "refresh_cache-3d06fffa-bbb3-4853-8fad-b2e3ea89607c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Instance network_info: |[{"id": "43613540-5fba-41ad-8378-9f02b51dbf04", "address": "fa:16:3e:89:ed:59", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43613540-5f", "ovs_interfaceid": "43613540-5fba-41ad-8378-9f02b51dbf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6738a77d-d530-441d-9dc3-5aa1e7496e63 req-0c2c1e2b-ca25-41c3-9342-db5084b3856d service nova] Acquired lock "refresh_cache-3d06fffa-bbb3-4853-8fad-b2e3ea89607c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-6738a77d-d530-441d-9dc3-5aa1e7496e63 req-0c2c1e2b-ca25-41c3-9342-db5084b3856d service nova] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Refreshing network info cache for port 43613540-5fba-41ad-8378-9f02b51dbf04 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Start _get_guest_xml network_info=[{"id": "43613540-5fba-41ad-8378-9f02b51dbf04", "address": "fa:16:3e:89:ed:59", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43613540-5f", "ovs_interfaceid": "43613540-5fba-41ad-8378-9f02b51dbf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:52:18 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:52:18 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1940308953',display_name='tempest-ServersNegativeTestJSON-server-1940308953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1940308953',id=11,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad83f3fea7fc4f308278ab8be165e86b',ramdisk_id='',reservation_id='r-0eay2bgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1521565055',owner_user_name='tempest-ServersNegativeTestJSON-1521565055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:16Z,user_data=None,user_id='fa0d70bee1b64b939678aec53d77c0fd',uuid=3d06fffa-bbb3-4853-8fad-b2e3ea89607c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43613540-5fba-41ad-8378-9f02b51dbf04", "address": "fa:16:3e:89:ed:59", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43613540-5f", "ovs_interfaceid": "43613540-5fba-41ad-8378-9f02b51dbf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Converting VIF {"id": "43613540-5fba-41ad-8378-9f02b51dbf04", "address": "fa:16:3e:89:ed:59", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43613540-5f", "ovs_interfaceid": "43613540-5fba-41ad-8378-9f02b51dbf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:ed:59,bridge_name='br-int',has_traffic_filtering=True,id=43613540-5fba-41ad-8378-9f02b51dbf04,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43613540-5f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d06fffa-bbb3-4853-8fad-b2e3ea89607c {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Updating instance_info_cache with network_info: [{"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:52:18 user nova-compute[74278]:   <uuid>3d06fffa-bbb3-4853-8fad-b2e3ea89607c</uuid>
Oct 30 10:52:18 user nova-compute[74278]:   <name>instance-0000000b</name>
Oct 30 10:52:18 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:52:18 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:52:18 user nova-compute[74278]:   <metadata>
Oct 30 10:52:18 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:52:18 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:52:18 user nova-compute[74278]:       <nova:name>tempest-ServersNegativeTestJSON-server-1940308953</nova:name>
Oct 30 10:52:18 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:52:18</nova:creationTime>
Oct 30 10:52:18 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:52:18 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:52:18 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:52:18 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:52:18 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:52:18 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:52:18 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:52:18 user nova-compute[74278]:       <nova:owner>
Oct 30 10:52:18 user nova-compute[74278]:         <nova:user uuid="fa0d70bee1b64b939678aec53d77c0fd">tempest-ServersNegativeTestJSON-1521565055-project-member</nova:user>
Oct 30 10:52:18 user nova-compute[74278]:         <nova:project uuid="ad83f3fea7fc4f308278ab8be165e86b">tempest-ServersNegativeTestJSON-1521565055</nova:project>
Oct 30 10:52:18 user nova-compute[74278]:       </nova:owner>
Oct 30 10:52:18 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:52:18 user nova-compute[74278]:       <nova:ports>
Oct 30 10:52:18 user nova-compute[74278]:         <nova:port uuid="43613540-5fba-41ad-8378-9f02b51dbf04">
Oct 30 10:52:18 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 10:52:18 user nova-compute[74278]:         </nova:port>
Oct 30 10:52:18 user nova-compute[74278]:       </nova:ports>
Oct 30 10:52:18 user nova-compute[74278]:     </nova:instance>
Oct 30 10:52:18 user nova-compute[74278]:   </metadata>
Oct 30 10:52:18 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:52:18 user nova-compute[74278]:     <system>
Oct 30 10:52:18 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:52:18 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:52:18 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:52:18 user nova-compute[74278]:       <entry name="serial">3d06fffa-bbb3-4853-8fad-b2e3ea89607c</entry>
Oct 30 10:52:18 user nova-compute[74278]:       <entry name="uuid">3d06fffa-bbb3-4853-8fad-b2e3ea89607c</entry>
Oct 30 10:52:18 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:52:18 user nova-compute[74278]:     </system>
Oct 30 10:52:18 user nova-compute[74278]:   </sysinfo>
Oct 30 10:52:18 user nova-compute[74278]:   <os>
Oct 30 10:52:18 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:52:18 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:52:18 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:52:18 user nova-compute[74278]:   </os>
Oct 30 10:52:18 user nova-compute[74278]:   <features>
Oct 30 10:52:18 user nova-compute[74278]:     <acpi/>
Oct 30 10:52:18 user nova-compute[74278]:     <apic/>
Oct 30 10:52:18 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:52:18 user nova-compute[74278]:   </features>
Oct 30 10:52:18 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:52:18 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:52:18 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:52:18 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:52:18 user nova-compute[74278]:   </clock>
Oct 30 10:52:18 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:52:18 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:52:18 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:52:18 user nova-compute[74278]:   </cpu>
Oct 30 10:52:18 user nova-compute[74278]:   <devices>
Oct 30 10:52:18 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:52:18 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:52:18 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk"/>
Oct 30 10:52:18 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:52:18 user nova-compute[74278]:     </disk>
Oct 30 10:52:18 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:52:18 user nova-compute[74278]:       <mac address="fa:16:3e:89:ed:59"/>
Oct 30 10:52:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:52:18 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:52:18 user nova-compute[74278]:       <target dev="tap43613540-5f"/>
Oct 30 10:52:18 user nova-compute[74278]:     </interface>
Oct 30 10:52:18 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:52:18 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/console.log" append="off"/>
Oct 30 10:52:18 user nova-compute[74278]:     </serial>
Oct 30 10:52:18 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:52:18 user nova-compute[74278]:     <video>
Oct 30 10:52:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:52:18 user nova-compute[74278]:     </video>
Oct 30 10:52:18 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:52:18 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:52:18 user nova-compute[74278]:     </rng>
Oct 30 10:52:18 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:52:18 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:52:18 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:52:18 user nova-compute[74278]:     </memballoon>
Oct 30 10:52:18 user nova-compute[74278]:   </devices>
Oct 30 10:52:18 user nova-compute[74278]: </domain>
Oct 30 10:52:18 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1940308953',display_name='tempest-ServersNegativeTestJSON-server-1940308953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1940308953',id=11,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad83f3fea7fc4f308278ab8be165e86b',ramdisk_id='',reservation_id='r-0eay2bgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1521565055',owner_user_name='tempest-ServersNegativeTestJSON-1521565055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:16Z,user_data=None,user_id='fa0d70bee1b64b939678aec53d77c0fd',uuid=3d06fffa-bbb3-4853-8fad-b2e3ea89607c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43613540-5fba-41ad-8378-9f02b51dbf04", "address": "fa:16:3e:89:ed:59", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43613540-5f", "ovs_interfaceid": "43613540-5fba-41ad-8378-9f02b51dbf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Converting VIF {"id": "43613540-5fba-41ad-8378-9f02b51dbf04", "address": "fa:16:3e:89:ed:59", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43613540-5f", "ovs_interfaceid": "43613540-5fba-41ad-8378-9f02b51dbf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:ed:59,bridge_name='br-int',has_traffic_filtering=True,id=43613540-5fba-41ad-8378-9f02b51dbf04,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43613540-5f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG os_vif [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ed:59,bridge_name='br-int',has_traffic_filtering=True,id=43613540-5fba-41ad-8378-9f02b51dbf04,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43613540-5f') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef6a65a9-212c-5759-a5be-634075c5f23a', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43613540-5f, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43613540-5f, col_values=(('qos', UUID('dd969c0e-e6cf-4069-a638-96bb0f5c4140')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43613540-5f, col_values=(('external_ids', {'iface-id': '43613540-5fba-41ad-8378-9f02b51dbf04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:ed:59', 'vm-uuid': '3d06fffa-bbb3-4853-8fad-b2e3ea89607c'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:18 user nova-compute[74278]: INFO os_vif [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ed:59,bridge_name='br-int',has_traffic_filtering=True,id=43613540-5fba-41ad-8378-9f02b51dbf04,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43613540-5f')
Oct 30 10:52:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] No VIF found with MAC fa:16:3e:89:ed:59, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-6738a77d-d530-441d-9dc3-5aa1e7496e63 req-0c2c1e2b-ca25-41c3-9342-db5084b3856d service nova] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Updated VIF entry in instance network info cache for port 43613540-5fba-41ad-8378-9f02b51dbf04. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-6738a77d-d530-441d-9dc3-5aa1e7496e63 req-0c2c1e2b-ca25-41c3-9342-db5084b3856d service nova] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Updating instance_info_cache with network_info: [{"id": "43613540-5fba-41ad-8378-9f02b51dbf04", "address": "fa:16:3e:89:ed:59", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43613540-5f", "ovs_interfaceid": "43613540-5fba-41ad-8378-9f02b51dbf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6738a77d-d530-441d-9dc3-5aa1e7496e63 req-0c2c1e2b-ca25-41c3-9342-db5084b3856d service nova] Releasing lock "refresh_cache-3d06fffa-bbb3-4853-8fad-b2e3ea89607c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-28d0a942-8f84-4c48-9c25-e1cc00d6013f req-9f19de72-0a2b-4c98-9be8-de8479706c33 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-changed-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-28d0a942-8f84-4c48-9c25-e1cc00d6013f req-9f19de72-0a2b-4c98-9be8-de8479706c33 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Refreshing instance network info cache due to event network-changed-346d37bb-4749-43ab-b83e-c0472def78b2. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-28d0a942-8f84-4c48-9c25-e1cc00d6013f req-9f19de72-0a2b-4c98-9be8-de8479706c33 service nova] Acquiring lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-28d0a942-8f84-4c48-9c25-e1cc00d6013f req-9f19de72-0a2b-4c98-9be8-de8479706c33 service nova] Acquired lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:19 user nova-compute[74278]: DEBUG nova.network.neutron [req-28d0a942-8f84-4c48-9c25-e1cc00d6013f req-9f19de72-0a2b-4c98-9be8-de8479706c33 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Refreshing network info cache for port 346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:20 user nova-compute[74278]: DEBUG nova.network.neutron [req-28d0a942-8f84-4c48-9c25-e1cc00d6013f req-9f19de72-0a2b-4c98-9be8-de8479706c33 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updated VIF entry in instance network info cache for port 346d37bb-4749-43ab-b83e-c0472def78b2. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:52:20 user nova-compute[74278]: DEBUG nova.network.neutron [req-28d0a942-8f84-4c48-9c25-e1cc00d6013f req-9f19de72-0a2b-4c98-9be8-de8479706c33 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating instance_info_cache with network_info: [{"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-28d0a942-8f84-4c48-9c25-e1cc00d6013f req-9f19de72-0a2b-4c98-9be8-de8479706c33 service nova] Releasing lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:20 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Snapshot image upload complete
Oct 30 10:52:20 user nova-compute[74278]: INFO nova.compute.manager [None req-43a5b579-206d-4d8b-8022-035c2b8740ee tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Took 5.90 seconds to snapshot the instance on the hypervisor.
Oct 30 10:52:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-dfc5e188-8ca1-4466-8420-daa947035fc8 req-ea57d2f8-5c4d-4af9-95e9-fb19b07e10c8 service nova] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Received event network-vif-plugged-43613540-5fba-41ad-8378-9f02b51dbf04 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-dfc5e188-8ca1-4466-8420-daa947035fc8 req-ea57d2f8-5c4d-4af9-95e9-fb19b07e10c8 service nova] Acquiring lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-dfc5e188-8ca1-4466-8420-daa947035fc8 req-ea57d2f8-5c4d-4af9-95e9-fb19b07e10c8 service nova] Lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-dfc5e188-8ca1-4466-8420-daa947035fc8 req-ea57d2f8-5c4d-4af9-95e9-fb19b07e10c8 service nova] Lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-dfc5e188-8ca1-4466-8420-daa947035fc8 req-ea57d2f8-5c4d-4af9-95e9-fb19b07e10c8 service nova] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] No waiting events found dispatching network-vif-plugged-43613540-5fba-41ad-8378-9f02b51dbf04 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:52:20 user nova-compute[74278]: WARNING nova.compute.manager [req-dfc5e188-8ca1-4466-8420-daa947035fc8 req-ea57d2f8-5c4d-4af9-95e9-fb19b07e10c8 service nova] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Received unexpected event network-vif-plugged-43613540-5fba-41ad-8378-9f02b51dbf04 for instance with vm_state building and task_state spawning.
Oct 30 10:52:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-bfe8bc99-9271-4cf2-a720-52571159abd3 req-32061372-d193-4b61-8a45-7d0cc3132447 service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Received event network-changed-be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-bfe8bc99-9271-4cf2-a720-52571159abd3 req-32061372-d193-4b61-8a45-7d0cc3132447 service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Refreshing instance network info cache due to event network-changed-be704baf-2542-497e-af45-bffa287fc1cd. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bfe8bc99-9271-4cf2-a720-52571159abd3 req-32061372-d193-4b61-8a45-7d0cc3132447 service nova] Acquiring lock "refresh_cache-84448e30-982f-4214-a61e-8cc5e122aef3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bfe8bc99-9271-4cf2-a720-52571159abd3 req-32061372-d193-4b61-8a45-7d0cc3132447 service nova] Acquired lock "refresh_cache-84448e30-982f-4214-a61e-8cc5e122aef3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:21 user nova-compute[74278]: DEBUG nova.network.neutron [req-bfe8bc99-9271-4cf2-a720-52571159abd3 req-32061372-d193-4b61-8a45-7d0cc3132447 service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Refreshing network info cache for port be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.network.neutron [req-bfe8bc99-9271-4cf2-a720-52571159abd3 req-32061372-d193-4b61-8a45-7d0cc3132447 service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Updated VIF entry in instance network info cache for port be704baf-2542-497e-af45-bffa287fc1cd. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.network.neutron [req-bfe8bc99-9271-4cf2-a720-52571159abd3 req-32061372-d193-4b61-8a45-7d0cc3132447 service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Updating instance_info_cache with network_info: [{"id": "be704baf-2542-497e-af45-bffa287fc1cd", "address": "fa:16:3e:27:25:f0", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe704baf-25", "ovs_interfaceid": "be704baf-2542-497e-af45-bffa287fc1cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bfe8bc99-9271-4cf2-a720-52571159abd3 req-32061372-d193-4b61-8a45-7d0cc3132447 service nova] Releasing lock "refresh_cache-84448e30-982f-4214-a61e-8cc5e122aef3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:52:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Instance spawned successfully.
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-4bd178e6-cfe4-4faa-a4ce-b9cbd665cfc5 req-b5939f3b-6f8f-4f3c-8747-b1090c4ebd1d service nova] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Received event network-vif-plugged-43613540-5fba-41ad-8378-9f02b51dbf04 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4bd178e6-cfe4-4faa-a4ce-b9cbd665cfc5 req-b5939f3b-6f8f-4f3c-8747-b1090c4ebd1d service nova] Acquiring lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4bd178e6-cfe4-4faa-a4ce-b9cbd665cfc5 req-b5939f3b-6f8f-4f3c-8747-b1090c4ebd1d service nova] Lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4bd178e6-cfe4-4faa-a4ce-b9cbd665cfc5 req-b5939f3b-6f8f-4f3c-8747-b1090c4ebd1d service nova] Lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-4bd178e6-cfe4-4faa-a4ce-b9cbd665cfc5 req-b5939f3b-6f8f-4f3c-8747-b1090c4ebd1d service nova] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] No waiting events found dispatching network-vif-plugged-43613540-5fba-41ad-8378-9f02b51dbf04 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:52:22 user nova-compute[74278]: WARNING nova.compute.manager [req-4bd178e6-cfe4-4faa-a4ce-b9cbd665cfc5 req-b5939f3b-6f8f-4f3c-8747-b1090c4ebd1d service nova] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Received unexpected event network-vif-plugged-43613540-5fba-41ad-8378-9f02b51dbf04 for instance with vm_state building and task_state spawning.
Oct 30 10:52:22 user nova-compute[74278]: INFO nova.compute.manager [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Took 6.75 seconds to spawn the instance on the hypervisor.
Oct 30 10:52:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:22 user nova-compute[74278]: INFO nova.compute.manager [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Took 7.92 seconds to build instance.
Oct 30 10:52:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e6101b91-0dfb-4de5-b6ed-2402a7786493 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.046s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:25 user nova-compute[74278]: INFO nova.virt.block_device [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Booting with volume 7e841c31-e573-410b-b282-1810a83a99e3 at /dev/vdb
Oct 30 10:52:25 user nova-compute[74278]: DEBUG os_brick.utils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfecad1-cbce-4582-a9c6-37d30e2ac961]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[507ea47b-96da-474d-adf3-a488d5209bbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2608d3-baae-4e18-ada4-62972d97433c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c84a42e-88e5-46cf-9426-c27f89673023]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:25 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ead90c6-1d0d-429d-8673-bdddcf2178e3]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG os_brick.utils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating existing volume attachment record: ca1f0789-b5df-46d4-9111-3672f7be0174 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:26 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:52:26 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:52:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7133MB free_disk=25.275386810302734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:52:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance d4d34729-e6b8-4f5c-aed8-b6f200287457 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 55cf7cd9-4e0b-4caa-874e-4963079e3b10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 84448e30-982f-4214-a61e-8cc5e122aef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 7264e69a-5781-420d-91b4-ab7d494c40ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0cecb81b-55ae-46de-8f32-433f2ff42bad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance d71474f7-0b91-49e5-b03b-56628ae7823e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 3c26a595-b269-44b0-bf02-43b6b768183e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 3d06fffa-bbb3-4853-8fad-b2e3ea89607c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:52:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:52:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:52:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:52:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:52:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "84448e30-982f-4214-a61e-8cc5e122aef3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "84448e30-982f-4214-a61e-8cc5e122aef3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:28 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'flavor' on Instance uuid 84448e30-982f-4214-a61e-8cc5e122aef3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:52:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "84448e30-982f-4214-a61e-8cc5e122aef3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "84448e30-982f-4214-a61e-8cc5e122aef3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "84448e30-982f-4214-a61e-8cc5e122aef3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:29 user nova-compute[74278]: INFO nova.compute.manager [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Attaching volume b83bfcc3-9672-497c-9efb-20674076c7a6 to /dev/vdb
Oct 30 10:52:29 user nova-compute[74278]: DEBUG os_brick.utils [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab37d4-423e-4a50-bc43-ed999ca75b3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac41d8ec-7ae5-4d75-98f0-805e69e382e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e64d55a-1615-401e-8912-f7bac1aaea03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5547a72-cccf-4e76-a6fa-f441023f5803]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:29 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:52:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dd5281-92b7-40d7-9fc3-554a5685e1c0]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG os_brick.utils [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:52:29 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Updating existing volume attachment record: ae5fe235-2c24-47c2-abc6-60796e75b897 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:52:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:37 user nova-compute[74278]: DEBUG nova.compute.manager [req-8c6423a3-ccab-4985-9b1c-513ec1dd1d8c req-1ef4a280-4963-49f9-a0d3-ec883e67d7f9 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Received event network-changed-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:37 user nova-compute[74278]: DEBUG nova.compute.manager [req-8c6423a3-ccab-4985-9b1c-513ec1dd1d8c req-1ef4a280-4963-49f9-a0d3-ec883e67d7f9 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Refreshing instance network info cache due to event network-changed-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c6423a3-ccab-4985-9b1c-513ec1dd1d8c req-1ef4a280-4963-49f9-a0d3-ec883e67d7f9 service nova] Acquiring lock "refresh_cache-21d2a8cc-39ee-435e-9936-d1585a9386b7" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c6423a3-ccab-4985-9b1c-513ec1dd1d8c req-1ef4a280-4963-49f9-a0d3-ec883e67d7f9 service nova] Acquired lock "refresh_cache-21d2a8cc-39ee-435e-9936-d1585a9386b7" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:37 user nova-compute[74278]: DEBUG nova.network.neutron [req-8c6423a3-ccab-4985-9b1c-513ec1dd1d8c req-1ef4a280-4963-49f9-a0d3-ec883e67d7f9 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Refreshing network info cache for port 6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG nova.network.neutron [req-8c6423a3-ccab-4985-9b1c-513ec1dd1d8c req-1ef4a280-4963-49f9-a0d3-ec883e67d7f9 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Updated VIF entry in instance network info cache for port 6c7b9741-ec03-46ec-bc59-c3c7ad1bf369. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG nova.network.neutron [req-8c6423a3-ccab-4985-9b1c-513ec1dd1d8c req-1ef4a280-4963-49f9-a0d3-ec883e67d7f9 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Updating instance_info_cache with network_info: [{"id": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "address": "fa:16:3e:d1:b8:2b", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7b9741-ec", "ovs_interfaceid": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c6423a3-ccab-4985-9b1c-513ec1dd1d8c req-1ef4a280-4963-49f9-a0d3-ec883e67d7f9 service nova] Releasing lock "refresh_cache-21d2a8cc-39ee-435e-9936-d1585a9386b7" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connector [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Factory for ISCSI on None {{(pid=74278) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MetzTPBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:52:38 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:52:38 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:52:38 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fdd735-8311-42ad-8bb1-b1612cd117f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:52:38 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dfb167-c874-444f-ba29-00000c2e3c22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97] added
Oct 30 10:52:38 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0191ddbe-86c3-441a-aba2-1debde29e66e]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[de976c68-0b4e-4c5a-86be-e6b7e7678bb8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MetzTPBf {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MetzTPBf" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[69597594-5fef-4059-b91e-03b6a16ef6d8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MetzTPBf'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[86545166-1252-4513-824d-c5ae274d38b4]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[48635094-f9d5-44fd-873a-998d88a1bf75]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 10:52:38 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 10:52:38 user nova-compute[74278]:  {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:52:38 user nova-compute[74278]: WARNING os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 10:52:38 user nova-compute[74278]: 
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[07433d2c-6702-44fe-bc01-3ea796e9bc7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97, portal: 172.16.0.220,3260]
Oct 30 10:52:38 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97, portal: 172.16.0.220,3260] successful.
Oct 30 10:52:38 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edfa812-0866-462e-91fe-b4a6fd77465b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f246118-95ce-4c0b-8a26-bd81899fe452]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 (non-flash)
Oct 30 10:52:38 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 (non-flash)
Oct 30 10:52:38 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebffa3e-3f71-4163-977d-e76c13313b45]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:52:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MetzTPBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:52:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:52:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26130353537653664', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:52:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130353537653664', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:52:39 user nova-compute[74278]: DEBUG nova.objects.instance [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lazy-loading 'flavor' on Instance uuid d4d34729-e6b8-4f5c-aed8-b6f200287457 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:52:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 10:52:40 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:52:40 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 10:52:40 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:52:40 user nova-compute[74278]:   <serial>a1e0d5b7-30ce-446d-a424-f19092689a97</serial>
Oct 30 10:52:40 user nova-compute[74278]: </disk>
Oct 30 10:52:40 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 10:52:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:52:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:52:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] No VIF found with MAC fa:16:3e:8c:9d:d4, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:52:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5030b494-de5a-48d8-9563-fcb21d163b39 tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.138s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "d4d34729-e6b8-4f5c-aed8-b6f200287457" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:41 user nova-compute[74278]: INFO nova.compute.manager [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Terminating instance
Oct 30 10:52:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-62c55560-7696-4d71-8117-e2ad76a05e6c req-743745e9-474a-493d-8ca7-1b091808c0a6 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Received event network-vif-unplugged-79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-62c55560-7696-4d71-8117-e2ad76a05e6c req-743745e9-474a-493d-8ca7-1b091808c0a6 service nova] Acquiring lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-62c55560-7696-4d71-8117-e2ad76a05e6c req-743745e9-474a-493d-8ca7-1b091808c0a6 service nova] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-62c55560-7696-4d71-8117-e2ad76a05e6c req-743745e9-474a-493d-8ca7-1b091808c0a6 service nova] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-62c55560-7696-4d71-8117-e2ad76a05e6c req-743745e9-474a-493d-8ca7-1b091808c0a6 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] No waiting events found dispatching network-vif-unplugged-79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-62c55560-7696-4d71-8117-e2ad76a05e6c req-743745e9-474a-493d-8ca7-1b091808c0a6 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Received event network-vif-unplugged-79987a93-94db-41fb-b192-9d8ceaa56407 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:52:41 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Instance destroyed successfully.
Oct 30 10:52:41 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lazy-loading 'resources' on Instance uuid d4d34729-e6b8-4f5c-aed8-b6f200287457 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1680744787',display_name='tempest-DeleteServersTestJSON-server-1680744787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1680744787',id=1,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:50:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='180c08739aa54f4f92350dd647aa73e1',ramdisk_id='',reservation_id='r-mdtz0p9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1024185865',owner_user_name='tempest-DeleteServersTestJSON-1024185865-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:50:41Z,user_data=None,user_id='65d733144b1c447daa4cbf134850e41a',uuid=d4d34729-e6b8-4f5c-aed8-b6f200287457,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79987a93-94db-41fb-b192-9d8ceaa56407", "address": "fa:16:3e:8c:9d:d4", "network": {"id": "e5fe74b4-ac3e-43a1-94b5-80493fdab5c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-349284564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "180c08739aa54f4f92350dd647aa73e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79987a93-94", "ovs_interfaceid": "79987a93-94db-41fb-b192-9d8ceaa56407", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Converting VIF {"id": "79987a93-94db-41fb-b192-9d8ceaa56407", "address": "fa:16:3e:8c:9d:d4", "network": {"id": "e5fe74b4-ac3e-43a1-94b5-80493fdab5c9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-349284564-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "180c08739aa54f4f92350dd647aa73e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79987a93-94", "ovs_interfaceid": "79987a93-94db-41fb-b192-9d8ceaa56407", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:9d:d4,bridge_name='br-int',has_traffic_filtering=True,id=79987a93-94db-41fb-b192-9d8ceaa56407,network=Network(e5fe74b4-ac3e-43a1-94b5-80493fdab5c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79987a93-94') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG os_vif [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:9d:d4,bridge_name='br-int',has_traffic_filtering=True,id=79987a93-94db-41fb-b192-9d8ceaa56407,network=Network(e5fe74b4-ac3e-43a1-94b5-80493fdab5c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79987a93-94') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79987a93-94, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:52:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46220f1c-5439-462a-8ec8-fdf75f24185e) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:42 user nova-compute[74278]: INFO os_vif [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:9d:d4,bridge_name='br-int',has_traffic_filtering=True,id=79987a93-94db-41fb-b192-9d8ceaa56407,network=Network(e5fe74b4-ac3e-43a1-94b5-80493fdab5c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79987a93-94')
Oct 30 10:52:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MetzTPBf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:52:42 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd92c46c-a91b-4d81-8b6a-e04c9c452a81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:52:42 user nova-compute[74278]: No targets found.
Oct 30 10:52:42 user nova-compute[74278]: iSNS:
Oct 30 10:52:42 user nova-compute[74278]: No targets found.
Oct 30 10:52:42 user nova-compute[74278]: STATIC:
Oct 30 10:52:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97
Oct 30 10:52:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:52:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:52:42 user nova-compute[74278]: FIRMWARE:
Oct 30 10:52:42 user nova-compute[74278]: No targets found.
Oct 30 10:52:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:52:42 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:52:42 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[60876c01-35af-48d4-b2ec-d4707052f199]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a92499f-74b2-44a0-b607-fff9500de44a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 (non-flash)
Oct 30 10:52:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 (non-flash)
Oct 30 10:52:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac13f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[738f5e5b-0e0d-42dd-82f6-202ff6ebd84b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[945cab5e-ef52-49de-a004-0ac96574c2ca]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e407beaf-34b4-49e8-bff6-490e20fe2426]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d12307-75f3-409b-839b-72fe1f83d0c8]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2831aef5-d9a3-46e6-b8f2-70c6071ba3c1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[62035a24-40cf-49d2-a6c2-ad7ee96b32e8]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97, portal: 172.16.0.220,3260]
Oct 30 10:52:42 user nova-compute[74278]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97, portal: 172.16.0.220,3260] successful.
Oct 30 10:52:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1e0d5b7-30ce-446d-a424-f19092689a97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[da64b710-5665-4702-a47f-fcdc7c263b4f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] <== disconnect_volume: return (307ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:52:42 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Deleting instance files /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457_del
Oct 30 10:52:42 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Deletion of /opt/stack/data/nova/instances/d4d34729-e6b8-4f5c-aed8-b6f200287457_del complete
Oct 30 10:52:42 user nova-compute[74278]: INFO nova.compute.manager [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Took 1.23 seconds to destroy the instance on the hypervisor.
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-d9042b83-fcbd-4707-8240-682106414d71 req-ed5031fa-6062-4277-81d6-d27d4220a5cc service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Received event network-changed-101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-d9042b83-fcbd-4707-8240-682106414d71 req-ed5031fa-6062-4277-81d6-d27d4220a5cc service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Refreshing instance network info cache due to event network-changed-101928c4-5d7d-49b7-bb17-d730e91d9d50. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d9042b83-fcbd-4707-8240-682106414d71 req-ed5031fa-6062-4277-81d6-d27d4220a5cc service nova] Acquiring lock "refresh_cache-7264e69a-5781-420d-91b4-ab7d494c40ca" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d9042b83-fcbd-4707-8240-682106414d71 req-ed5031fa-6062-4277-81d6-d27d4220a5cc service nova] Acquired lock "refresh_cache-7264e69a-5781-420d-91b4-ab7d494c40ca" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:42 user nova-compute[74278]: DEBUG nova.network.neutron [req-d9042b83-fcbd-4707-8240-682106414d71 req-ed5031fa-6062-4277-81d6-d27d4220a5cc service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Refreshing network info cache for port 101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-51e5191f-6fdc-4c4f-8a1b-80cd3dc5b23e req-8e239081-70f5-4302-9b24-ce263d1a8514 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Received event network-vif-plugged-79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-51e5191f-6fdc-4c4f-8a1b-80cd3dc5b23e req-8e239081-70f5-4302-9b24-ce263d1a8514 service nova] Acquiring lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-51e5191f-6fdc-4c4f-8a1b-80cd3dc5b23e req-8e239081-70f5-4302-9b24-ce263d1a8514 service nova] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-51e5191f-6fdc-4c4f-8a1b-80cd3dc5b23e req-8e239081-70f5-4302-9b24-ce263d1a8514 service nova] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-51e5191f-6fdc-4c4f-8a1b-80cd3dc5b23e req-8e239081-70f5-4302-9b24-ce263d1a8514 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] No waiting events found dispatching network-vif-plugged-79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:52:43 user nova-compute[74278]: WARNING nova.compute.manager [req-51e5191f-6fdc-4c4f-8a1b-80cd3dc5b23e req-8e239081-70f5-4302-9b24-ce263d1a8514 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Received unexpected event network-vif-plugged-79987a93-94db-41fb-b192-9d8ceaa56407 for instance with vm_state active and task_state deleting.
Oct 30 10:52:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:43 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:43 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Took 1.44 seconds to deallocate network for instance.
Oct 30 10:52:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-2185f57b-6265-4e84-9bc2-45fe4f530183 req-196edd19-9d4c-42ed-a816-e5a9a31bdee6 service nova] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Received event network-vif-deleted-79987a93-94db-41fb-b192-9d8ceaa56407 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-d9042b83-fcbd-4707-8240-682106414d71 req-ed5031fa-6062-4277-81d6-d27d4220a5cc service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Updated VIF entry in instance network info cache for port 101928c4-5d7d-49b7-bb17-d730e91d9d50. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:52:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-d9042b83-fcbd-4707-8240-682106414d71 req-ed5031fa-6062-4277-81d6-d27d4220a5cc service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Updating instance_info_cache with network_info: [{"id": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "address": "fa:16:3e:5b:71:4c", "network": {"id": "26926697-8d50-436c-bf17-1acc7adfb34b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1400788987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38de12f052e945949c11b4b0603b0610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap101928c4-5d", "ovs_interfaceid": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d9042b83-fcbd-4707-8240-682106414d71 req-ed5031fa-6062-4277-81d6-d27d4220a5cc service nova] Releasing lock "refresh_cache-7264e69a-5781-420d-91b4-ab7d494c40ca" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:44 user nova-compute[74278]: INFO nova.compute.manager [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] [instance: d4d34729-e6b8-4f5c-aed8-b6f200287457] Took 1.00 seconds to detach 1 volumes for instance.
Oct 30 10:52:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:45 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:52:45 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:52:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:45 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Deleted allocations for instance d4d34729-e6b8-4f5c-aed8-b6f200287457
Oct 30 10:52:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1dd4cab9-f4ed-4f20-ba12-d568040d479f tempest-DeleteServersTestJSON-1024185865 tempest-DeleteServersTestJSON-1024185865-project-member] Lock "d4d34729-e6b8-4f5c-aed8-b6f200287457" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.352s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:46 user nova-compute[74278]: INFO nova.virt.block_device [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Booting with volume 352a4886-2b5c-478c-bddb-47be3ae313db at /dev/vdc
Oct 30 10:52:46 user nova-compute[74278]: DEBUG os_brick.utils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5c439e-1911-440e-971d-2d677a5ee650]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5f230e-9931-472f-be2c-a56e83645128]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1008abb7-e61f-4b21-b73b-b937ba1fb5f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[753f84ab-2b44-494b-ab7a-b1ed49da4cc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:46 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:52:46 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78f0ef5-3209-4ec9-91a8-e560edddeed8]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG os_brick.utils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:52:46 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating existing volume attachment record: 475c8f10-6d66-4b57-a706-3f4f3c51ad1a {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-750e5a38-f2ba-4239-8a75-2b47be564749 req-5581b746-d237-435c-9447-b2931ef82934 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-changed-a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-750e5a38-f2ba-4239-8a75-2b47be564749 req-5581b746-d237-435c-9447-b2931ef82934 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Refreshing instance network info cache due to event network-changed-a719761e-73d6-414b-a6d5-68e6b757e402. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-750e5a38-f2ba-4239-8a75-2b47be564749 req-5581b746-d237-435c-9447-b2931ef82934 service nova] Acquiring lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-750e5a38-f2ba-4239-8a75-2b47be564749 req-5581b746-d237-435c-9447-b2931ef82934 service nova] Acquired lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG nova.network.neutron [req-750e5a38-f2ba-4239-8a75-2b47be564749 req-5581b746-d237-435c-9447-b2931ef82934 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Refreshing network info cache for port a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "interface-0cecb81b-55ae-46de-8f32-433f2ff42bad-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "interface-0cecb81b-55ae-46de-8f32-433f2ff42bad-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG nova.objects.instance [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lazy-loading 'flavor' on Instance uuid 0cecb81b-55ae-46de-8f32-433f2ff42bad {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG nova.network.neutron [req-750e5a38-f2ba-4239-8a75-2b47be564749 req-5581b746-d237-435c-9447-b2931ef82934 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Updated VIF entry in instance network info cache for port a719761e-73d6-414b-a6d5-68e6b757e402. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG nova.network.neutron [req-750e5a38-f2ba-4239-8a75-2b47be564749 req-5581b746-d237-435c-9447-b2931ef82934 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Updating instance_info_cache with network_info: [{"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-750e5a38-f2ba-4239-8a75-2b47be564749 req-5581b746-d237-435c-9447-b2931ef82934 service nova] Releasing lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG nova.objects.instance [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lazy-loading 'pci_requests' on Instance uuid 0cecb81b-55ae-46de-8f32-433f2ff42bad {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG nova.objects.base [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Object Instance<0cecb81b-55ae-46de-8f32-433f2ff42bad> lazy-loaded attributes: flavor,pci_requests {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG nova.network.neutron [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:52:47 user nova-compute[74278]: DEBUG nova.policy [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6b046e419a34ce591eebd5c11332017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '253f67cb486c46d1ad6e5ca4b1287893', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:52:48 user nova-compute[74278]: DEBUG nova.network.neutron [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Successfully created port: 181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:52:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.network.neutron [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Successfully updated port: 181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquired lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.network.neutron [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-9033bcdf-0910-4ebc-8f2f-e8d3ea25bbac req-d35e98c1-9cf5-4317-b596-2535fdd75a76 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-changed-181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-9033bcdf-0910-4ebc-8f2f-e8d3ea25bbac req-d35e98c1-9cf5-4317-b596-2535fdd75a76 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Refreshing instance network info cache due to event network-changed-181a6ded-caac-4f51-ac21-3972c8cc8320. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9033bcdf-0910-4ebc-8f2f-e8d3ea25bbac req-d35e98c1-9cf5-4317-b596-2535fdd75a76 service nova] Acquiring lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "7264e69a-5781-420d-91b4-ab7d494c40ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.objects.instance [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lazy-loading 'flavor' on Instance uuid 7264e69a-5781-420d-91b4-ab7d494c40ca {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.network.neutron [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Updating instance_info_cache with network_info: [{"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Releasing lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9033bcdf-0910-4ebc-8f2f-e8d3ea25bbac req-d35e98c1-9cf5-4317-b596-2535fdd75a76 service nova] Acquired lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.network.neutron [req-9033bcdf-0910-4ebc-8f2f-e8d3ea25bbac req-d35e98c1-9cf5-4317-b596-2535fdd75a76 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Refreshing network info cache for port 181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1244481291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1244481291',id=8,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hCZm+p9pneLXjvGF3q+uUILN9j75Q8EhDi66gIZTDo8x7vX6mAeb+cwmbpumy2JKJSnUtNn0gun7/lwnmnulLD1nk9wxII3Jt323IfPYgkyT8hzWa5M48LRz07jpuRw==',key_name='tempest-keypair-586447970',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:51:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='253f67cb486c46d1ad6e5ca4b1287893',ramdisk_id='',reservation_id='r-twe11yrb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-112217138',owner_user_name='tempest-TaggedAttachmentsTest-112217138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b046e419a34ce591eebd5c11332017',uuid=0cecb81b-55ae-46de-8f32-433f2ff42bad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converting VIF {"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:11:51,bridge_name='br-int',has_traffic_filtering=True,id=181a6ded-caac-4f51-ac21-3972c8cc8320,network=Network(8b040c63-4590-4a68-b47e-adf7aaba750f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6ded-ca') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG os_vif [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:11:51,bridge_name='br-int',has_traffic_filtering=True,id=181a6ded-caac-4f51-ac21-3972c8cc8320,network=Network(8b040c63-4590-4a68-b47e-adf7aaba750f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6ded-ca') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35977da4-65e5-505f-a348-653fc94e2944', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap181a6ded-ca, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap181a6ded-ca, col_values=(('qos', UUID('981dcdbe-a61d-4661-83ff-5a7a6da34313')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap181a6ded-ca, col_values=(('external_ids', {'iface-id': '181a6ded-caac-4f51-ac21-3972c8cc8320', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:11:51', 'vm-uuid': '0cecb81b-55ae-46de-8f32-433f2ff42bad'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:49 user nova-compute[74278]: INFO os_vif [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:11:51,bridge_name='br-int',has_traffic_filtering=True,id=181a6ded-caac-4f51-ac21-3972c8cc8320,network=Network(8b040c63-4590-4a68-b47e-adf7aaba750f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6ded-ca')
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1244481291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1244481291',id=8,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hCZm+p9pneLXjvGF3q+uUILN9j75Q8EhDi66gIZTDo8x7vX6mAeb+cwmbpumy2JKJSnUtNn0gun7/lwnmnulLD1nk9wxII3Jt323IfPYgkyT8hzWa5M48LRz07jpuRw==',key_name='tempest-keypair-586447970',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:51:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='253f67cb486c46d1ad6e5ca4b1287893',ramdisk_id='',reservation_id='r-twe11yrb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-112217138',owner_user_name='tempest-TaggedAttachmentsTest-112217138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b046e419a34ce591eebd5c11332017',uuid=0cecb81b-55ae-46de-8f32-433f2ff42bad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converting VIF {"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:11:51,bridge_name='br-int',has_traffic_filtering=True,id=181a6ded-caac-4f51-ac21-3972c8cc8320,network=Network(8b040c63-4590-4a68-b47e-adf7aaba750f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6ded-ca') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] attach device xml: <interface type="ethernet">
Oct 30 10:52:49 user nova-compute[74278]:   <mac address="fa:16:3e:68:11:51"/>
Oct 30 10:52:49 user nova-compute[74278]:   <model type="virtio"/>
Oct 30 10:52:49 user nova-compute[74278]:   <mtu size="1442"/>
Oct 30 10:52:49 user nova-compute[74278]:   <target dev="tap181a6ded-ca"/>
Oct 30 10:52:49 user nova-compute[74278]: </interface>
Oct 30 10:52:49 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "7264e69a-5781-420d-91b4-ab7d494c40ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:49 user nova-compute[74278]: INFO nova.compute.manager [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Attaching volume d6144d81-50f0-4fd8-8677-96d7ab12f44c to /dev/sdc
Oct 30 10:52:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] No BDM found with device name hda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] No VIF found with MAC fa:16:3e:ac:42:07, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG os_brick.utils [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG nova.network.neutron [req-9033bcdf-0910-4ebc-8f2f-e8d3ea25bbac req-d35e98c1-9cf5-4317-b596-2535fdd75a76 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Updated VIF entry in instance network info cache for port 181a6ded-caac-4f51-ac21-3972c8cc8320. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG nova.network.neutron [req-9033bcdf-0910-4ebc-8f2f-e8d3ea25bbac req-d35e98c1-9cf5-4317-b596-2535fdd75a76 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Updating instance_info_cache with network_info: [{"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f37fed-5c7c-4a2c-a0cb-137ab120d440]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:52:50 user nova-compute[74278]:   <nova:package version="0.0.0"/>
Oct 30 10:52:50 user nova-compute[74278]:   <nova:name>tempest-device-tagging-server-1244481291</nova:name>
Oct 30 10:52:50 user nova-compute[74278]:   <nova:creationTime>2023-10-30 10:52:50</nova:creationTime>
Oct 30 10:52:50 user nova-compute[74278]:   <nova:flavor name="m1.tiny">
Oct 30 10:52:50 user nova-compute[74278]:     <nova:memory>512</nova:memory>
Oct 30 10:52:50 user nova-compute[74278]:     <nova:disk>1</nova:disk>
Oct 30 10:52:50 user nova-compute[74278]:     <nova:swap>0</nova:swap>
Oct 30 10:52:50 user nova-compute[74278]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:52:50 user nova-compute[74278]:     <nova:vcpus>1</nova:vcpus>
Oct 30 10:52:50 user nova-compute[74278]:   </nova:flavor>
Oct 30 10:52:50 user nova-compute[74278]:   <nova:owner>
Oct 30 10:52:50 user nova-compute[74278]:     <nova:user uuid="c6b046e419a34ce591eebd5c11332017">tempest-TaggedAttachmentsTest-112217138-project-member</nova:user>
Oct 30 10:52:50 user nova-compute[74278]:     <nova:project uuid="253f67cb486c46d1ad6e5ca4b1287893">tempest-TaggedAttachmentsTest-112217138</nova:project>
Oct 30 10:52:50 user nova-compute[74278]:   </nova:owner>
Oct 30 10:52:50 user nova-compute[74278]:   <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:52:50 user nova-compute[74278]:   <nova:ports>
Oct 30 10:52:50 user nova-compute[74278]:     <nova:port uuid="a719761e-73d6-414b-a6d5-68e6b757e402">
Oct 30 10:52:50 user nova-compute[74278]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 10:52:50 user nova-compute[74278]:     </nova:port>
Oct 30 10:52:50 user nova-compute[74278]:     <nova:port uuid="181a6ded-caac-4f51-ac21-3972c8cc8320">
Oct 30 10:52:50 user nova-compute[74278]:       <nova:ip type="fixed" address="10.10.10.200" ipVersion="4"/>
Oct 30 10:52:50 user nova-compute[74278]:     </nova:port>
Oct 30 10:52:50 user nova-compute[74278]:   </nova:ports>
Oct 30 10:52:50 user nova-compute[74278]: </nova:instance>
Oct 30 10:52:50 user nova-compute[74278]:  {{(pid=74278) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9033bcdf-0910-4ebc-8f2f-e8d3ea25bbac req-d35e98c1-9cf5-4317-b596-2535fdd75a76 service nova] Releasing lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae719e8f-60a8-4715-ad11-58989f75061f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-90776c51-6235-453f-a879-bc749bf71f6c req-ddb8d89b-e8a6-4bbd-ab66-a6034d2b7705 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-vif-plugged-181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-90776c51-6235-453f-a879-bc749bf71f6c req-ddb8d89b-e8a6-4bbd-ab66-a6034d2b7705 service nova] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-90776c51-6235-453f-a879-bc749bf71f6c req-ddb8d89b-e8a6-4bbd-ab66-a6034d2b7705 service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-90776c51-6235-453f-a879-bc749bf71f6c req-ddb8d89b-e8a6-4bbd-ab66-a6034d2b7705 service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-90776c51-6235-453f-a879-bc749bf71f6c req-ddb8d89b-e8a6-4bbd-ab66-a6034d2b7705 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] No waiting events found dispatching network-vif-plugged-181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:52:50 user nova-compute[74278]: WARNING nova.compute.manager [req-90776c51-6235-453f-a879-bc749bf71f6c req-ddb8d89b-e8a6-4bbd-ab66-a6034d2b7705 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received unexpected event network-vif-plugged-181a6ded-caac-4f51-ac21-3972c8cc8320 for instance with vm_state active and task_state None.
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7c22dd6e-c608-404a-8f38-45998250867a tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "interface-0cecb81b-55ae-46de-8f32-433f2ff42bad-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.031s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5beff630-d862-4e47-a732-643ffc7132e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f0bbf0-e5b3-4662-be95-d42f929c8790]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:50 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:52:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a104f0-f5b0-45ab-a2e2-bc97c7597820]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG os_brick.utils [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Updating existing volume attachment record: 0bcd21e8-7018-4d1b-90c6-b821968a6dd6 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTmqxecC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:52:51 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:52:51 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:52:51 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[61099746-9b3b-49ad-a5f0-efe85517e96a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:52:51 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[175c3363-e109-4e11-bdbf-f8364c11810b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6] added
Oct 30 10:52:51 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0d9116-74c0-4315-aec9-5018346f5c2d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lazy-loading 'flavor' on Instance uuid 0cecb81b-55ae-46de-8f32-433f2ff42bad {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63cbd71-000b-442e-98cf-b140c6d3624d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oTmqxecC {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oTmqxecC" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b893841d-a92d-4640-811a-2036345d53c2]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oTmqxecC'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad5cb97-caff-48c8-b9c1-17e10a89e4a2]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1a7e67-40e4-4f0b-8884-91cb6e1da7e3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 10:52:51 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:52:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 10:52:51 user nova-compute[74278]:  {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:52:51 user nova-compute[74278]: WARNING os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 10:52:51 user nova-compute[74278]: 
Oct 30 10:52:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee9ff3e-a5e4-4ae3-b9bf-6b92e8f14995]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6, portal: 172.16.0.220,3260]
Oct 30 10:52:52 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6, portal: 172.16.0.220,3260] successful.
Oct 30 10:52:52 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24f59d7-795a-4782-9461-f5c950352bca]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8489c95d-6337-4367-9a3f-eef57c4c9e83]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:52:52 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:52:52 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[822512d6-160e-464e-84e8-2c43271a4fb2]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTmqxecC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG nova.compute.manager [req-d5500fc7-0011-49e5-b5f5-38914123224b req-61ec4b41-faeb-4b99-89fb-15c19ffa07ed service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-vif-plugged-181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d5500fc7-0011-49e5-b5f5-38914123224b req-61ec4b41-faeb-4b99-89fb-15c19ffa07ed service nova] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d5500fc7-0011-49e5-b5f5-38914123224b req-61ec4b41-faeb-4b99-89fb-15c19ffa07ed service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d5500fc7-0011-49e5-b5f5-38914123224b req-61ec4b41-faeb-4b99-89fb-15c19ffa07ed service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG nova.compute.manager [req-d5500fc7-0011-49e5-b5f5-38914123224b req-61ec4b41-faeb-4b99-89fb-15c19ffa07ed service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] No waiting events found dispatching network-vif-plugged-181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:52:52 user nova-compute[74278]: WARNING nova.compute.manager [req-d5500fc7-0011-49e5-b5f5-38914123224b req-61ec4b41-faeb-4b99-89fb-15c19ffa07ed service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received unexpected event network-vif-plugged-181a6ded-caac-4f51-ac21-3972c8cc8320 for instance with vm_state active and task_state None.
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:52:52 user nova-compute[74278]: INFO nova.compute.manager [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Attaching volume 37d70260-b46d-460b-a095-b586c3689985 to /dev/vdb
Oct 30 10:52:52 user nova-compute[74278]: DEBUG os_brick.utils [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22c2a33-9ab5-487a-a9d1-07c2037c29fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[afeb8ece-22aa-4163-b83d-b8999f52f908]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[26da00c7-1093-488f-95f7-9a0fffaf9f84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[717d6d06-8422-48fa-9a40-4b073956043f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:52:53 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:52:53 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b7ad8c-4c1e-4f36-a96b-0761843cfcb1]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG os_brick.utils [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Updating existing volume attachment record: eb3e7ccc-40ef-41a5-8934-4ec92a2baa03 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23935303338666165', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935303338666165', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'flavor' on Instance uuid 84448e30-982f-4214-a61e-8cc5e122aef3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 10:52:53 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:52:53 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 10:52:53 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:52:53 user nova-compute[74278]:   <serial>b83bfcc3-9672-497c-9efb-20674076c7a6</serial>
Oct 30 10:52:53 user nova-compute[74278]: </disk>
Oct 30 10:52:53 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:52:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No VIF found with MAC fa:16:3e:27:25:f0, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:52:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-96bfa387-db4a-4905-b37d-cd72924c3321 req-60cc8d59-5d4b-4d32-afa8-bd5beae94325 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Received event network-changed-4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:52:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-96bfa387-db4a-4905-b37d-cd72924c3321 req-60cc8d59-5d4b-4d32-afa8-bd5beae94325 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Refreshing instance network info cache due to event network-changed-4be24152-a25b-4a37-bdc9-93189991dde8. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:52:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-96bfa387-db4a-4905-b37d-cd72924c3321 req-60cc8d59-5d4b-4d32-afa8-bd5beae94325 service nova] Acquiring lock "refresh_cache-d71474f7-0b91-49e5-b03b-56628ae7823e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:52:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-96bfa387-db4a-4905-b37d-cd72924c3321 req-60cc8d59-5d4b-4d32-afa8-bd5beae94325 service nova] Acquired lock "refresh_cache-d71474f7-0b91-49e5-b03b-56628ae7823e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:52:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-96bfa387-db4a-4905-b37d-cd72924c3321 req-60cc8d59-5d4b-4d32-afa8-bd5beae94325 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Refreshing network info cache for port 4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:52:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-96bfa387-db4a-4905-b37d-cd72924c3321 req-60cc8d59-5d4b-4d32-afa8-bd5beae94325 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Updated VIF entry in instance network info cache for port 4be24152-a25b-4a37-bdc9-93189991dde8. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:52:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-96bfa387-db4a-4905-b37d-cd72924c3321 req-60cc8d59-5d4b-4d32-afa8-bd5beae94325 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Updating instance_info_cache with network_info: [{"id": "4be24152-a25b-4a37-bdc9-93189991dde8", "address": "fa:16:3e:81:3f:49", "network": {"id": "c6818f86-d1aa-4736-afbc-f516531a4a23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-83968978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40f572025eb4a8d98e01945f7375b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be24152-a2", "ovs_interfaceid": "4be24152-a25b-4a37-bdc9-93189991dde8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:52:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-96bfa387-db4a-4905-b37d-cd72924c3321 req-60cc8d59-5d4b-4d32-afa8-bd5beae94325 service nova] Releasing lock "refresh_cache-d71474f7-0b91-49e5-b03b-56628ae7823e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:52:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:52:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9a6f9782-74c4-41b0-91cd-251a582516be tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "84448e30-982f-4214-a61e-8cc5e122aef3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.382s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Acquiring lock "d71474f7-0b91-49e5-b03b-56628ae7823e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lazy-loading 'flavor' on Instance uuid d71474f7-0b91-49e5-b03b-56628ae7823e {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:53:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Creating image(s)
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Ensure instance console log exists: /opt/stack/data/nova/instances/3c26a595-b269-44b0-bf02-43b6b768183e/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Start _get_guest_xml network_info=[{"id": "edff675c-acda-4742-ad07-9d0467793110", "address": "fa:16:3e:b3:fb:38", "network": {"id": "19ff6d4c-75b3-458e-b3de-078a13b43272", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-53728059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff675c-ac", "ovs_interfaceid": "edff675c-acda-4742-ad07-9d0467793110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlnMTHKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3c26a595-b269-44b0-bf02-43b6b768183e', 'attached_at': '', 'detached_at': '', 'volume_id': '3b4bf1cf-571a-47d2-b86c-75e5e4210b47', 'serial': '3b4bf1cf-571a-47d2-b86c-75e5e4210b47'}, 'attachment_id': '62b350f8-461c-4b9d-b8a1-1ed879d05730', 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KNBCmvGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3c26a595-b269-44b0-bf02-43b6b768183e', 'attached_at': '', 'detached_at': '', 'volume_id': '7e841c31-e573-410b-b282-1810a83a99e3', 'serial': '7e841c31-e573-410b-b282-1810a83a99e3'}, 'attachment_id': 'ca1f0789-b5df-46d4-9111-3672f7be0174', 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYUaRKGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3c26a595-b269-44b0-bf02-43b6b768183e', 'attached_at': '', 'detached_at': '', 'volume_id': '352a4886-2b5c-478c-bddb-47be3ae313db', 'serial': '352a4886-2b5c-478c-bddb-47be3ae313db'}, 'attachment_id': '475c8f10-6d66-4b57-a706-3f4f3c51ad1a', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:53:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lazy-loading 'flavor' on Instance uuid 21d2a8cc-39ee-435e-9936-d1585a9386b7 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:53:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlnMTHKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:08 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:08 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:08 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[380be17f-770a-4f63-85f7-fb416de9ea9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:53:08 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21c6c65-96c9-4abc-9ca1-77fd18638734]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47] added
Oct 30 10:53:08 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d668e0-75bb-413b-9036-b7e8e7c48141]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.129s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee7da61-f24f-4cb9-8e73-dd94bf778993]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hlnMTHKe {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hlnMTHKe" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8462b612-9a73-4938-ac98-7d896af893f5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hlnMTHKe'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6839d4c6-6b1a-4a46-ae36-85472a53b537]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf54159-e5d0-4dbc-a04f-3bbea1c5cdf4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:08 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:08 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14d4b9d-0d90-4699-bfcc-cad441898ee2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47, portal: 172.16.0.220,3260]
Oct 30 10:53:08 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47, portal: 172.16.0.220,3260] successful.
Oct 30 10:53:08 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Acquiring lock "d71474f7-0b91-49e5-b03b-56628ae7823e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:08 user nova-compute[74278]: INFO nova.compute.manager [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Attaching volume 68b5dc17-836e-42da-a452-fe506684eda7 to /dev/vdb
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5224f5e-7d92-4046-bfa4-cbe307870f3c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ef618d-9a14-44ce-a039-8624f816d6b2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:08 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:08 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:08 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:08 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.459s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:08 user nova-compute[74278]: INFO nova.compute.manager [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Attaching volume 7335b8f1-2594-4f56-a717-bc2f9b1c6a4b to /dev/vdb
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d2e9ea-ac69-4b0a-a396-f8d62e4ce6e0]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlnMTHKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.utils [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55e1bf9-a426-42ac-b4da-6ddc4e2d6bf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ca018c-709e-48b4-96c1-2f7947c9fb7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d13bade-de1c-422f-b7c1-014c00818577]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7a83b8-7cb0-4bbe-bd7e-49e0f7fde5d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.utils [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcca777-c937-406c-94f3-f9f74ea4c654]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:53:08 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9a33c4-c1d0-4e58-ac7a-cdc68d1f46bc]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.utils [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Updating existing volume attachment record: 4a3edd4a-3931-4471-9d67-cbeb0f1171a0 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[19673d74-cbf3-4ee1-b5b0-2b4812e3c285]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[236308f6-dbfa-425f-afbd-d58f97109152]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6187e3-4f45-4e11-abfa-25edf8abcf6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:53:08 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:53:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b53ce2-200f-4265-a905-83163b6c7d18]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG os_brick.utils [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:53:08 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Updating existing volume attachment record: 759455ab-d34b-46dd-bf4a-fd33dad22dbf {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.505s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] <== connect_volume: return (1509ms) {'type': 'block', 'scsi_wwn': '23337643339643536', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337643339643536', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KNBCmvGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:09 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:09 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:09 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac11c77-f303-461a-baf8-333136bdd8e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:53:09 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42d0026-b85d-4572-9028-25c131626c4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3] added
Oct 30 10:53:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[493cb547-152d-4af5-8c48-c80304948840]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b106716b-40c5-4615-8bb3-a46eb9126f6f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KNBCmvGR {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KNBCmvGR" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cce567c-89df-4dd4-8f4e-c6d47213a912]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KNBCmvGR'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fea1c5-0207-4572-b58d-766b13f8a964]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb441fb-6d3d-4f35-a501-20ebadbaf2f0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:09 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:09 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[733a999a-a535-4df7-b01f-6fc19dc4b691]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3, portal: 172.16.0.220,3260]
Oct 30 10:53:09 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3, portal: 172.16.0.220,3260] successful.
Oct 30 10:53:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b54988-aee4-4436-bcb3-1ed28886bcbd]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0283731-f8d7-457e-9f57-bea0b1990d66]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:09 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:09 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:09 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:09 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[500c8947-d110-4a5b-a642-c072416bc8d1]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:09 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:53:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:53:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KNBCmvGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:53:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23863616565356663', 'path': '/dev/sdd'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:53:10 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863616565356663', 'path': '/dev/sdd'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYUaRKGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:11 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:11 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:11 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a925ec37-f5c3-4f8c-b831-ea7809feaba5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:53:11 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ce0036-1ebe-4f6f-8f57-345494f9298a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db] added
Oct 30 10:53:11 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6bc70d-9187-4822-9a32-ff3a3af6ab7d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d63c4f5-e461-4959-a812-d5a0003b4ae7]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYUaRKGo {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYUaRKGo" returned: 0 in 0.134s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[53904178-0481-44c8-86b4-0c9f04b40ed1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYUaRKGo'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf5cfd4-2b10-4152-8a37-71adf57bc95e]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d03d9c1-5246-4fbd-9461-d58d659e7f82]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:11 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:11 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:11 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:11 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:11 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:11 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cb335a-1875-4a5a-a782-d33e5fdc9a6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db, portal: 172.16.0.220,3260]
Oct 30 10:53:11 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db, portal: 172.16.0.220,3260] successful.
Oct 30 10:53:11 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[967e5187-c84c-4656-a7e5-3b8b7952cdb2]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed8c8ae-50b4-480b-8b31-b058f66650b1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:11 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:11 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:11 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:11 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:11 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:11 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:11 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:11 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[463ff334-f42f-4407-80c2-2e0c0ba34139]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "9b6f739d-461c-48a4-a4a7-5eebbca38913" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:53:12 user nova-compute[74278]: INFO nova.compute.claims [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Claim successful on node user
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYUaRKGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.482s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '26164636163663036', 'path': '/dev/sde'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164636163663036', 'path': '/dev/sde'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edff675c-acda-4742-ad07-9d0467793110", "address": "fa:16:3e:b3:fb:38", "network": {"id": "19ff6d4c-75b3-458e-b3de-078a13b43272", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-53728059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff675c-ac", "ovs_interfaceid": "edff675c-acda-4742-ad07-9d0467793110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "edff675c-acda-4742-ad07-9d0467793110", "address": "fa:16:3e:b3:fb:38", "network": {"id": "19ff6d4c-75b3-458e-b3de-078a13b43272", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-53728059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff675c-ac", "ovs_interfaceid": "edff675c-acda-4742-ad07-9d0467793110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:fb:38,bridge_name='br-int',has_traffic_filtering=True,id=edff675c-acda-4742-ad07-9d0467793110,network=Network(19ff6d4c-75b3-458e-b3de-078a13b43272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff675c-ac') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:4a:9e,bridge_name='br-int',has_traffic_filtering=True,id=04dc9645-4e3f-4ea7-9f9f-67d4b1df3688,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04dc9645-4e') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:37:63,bridge_name='br-int',has_traffic_filtering=True,id=f86eed54-e62f-496b-9a5f-ed15fb77dd3c,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf86eed54-e6') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8b:ad,bridge_name='br-int',has_traffic_filtering=True,id=64a18b70-db46-4f6e-825f-402681eca643,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a18b70-db') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:22:22,bridge_name='br-int',has_traffic_filtering=True,id=67ab7040-7f2b-4b2f-acb6-afa9d70c94ff,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab7040-7f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:ba,bridge_name='br-int',has_traffic_filtering=True,id=65829325-bf17-46c2-b8b3-8eba21130ce1,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65829325-bf') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:25,bridge_name='br-int',has_traffic_filtering=True,id=c65bf1e5-c95f-473e-9452-fc6ff873d709,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc65bf1e5-c9') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.objects.instance [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c26a595-b269-44b0-bf02-43b6b768183e {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:53:12 user nova-compute[74278]:   <uuid>3c26a595-b269-44b0-bf02-43b6b768183e</uuid>
Oct 30 10:53:12 user nova-compute[74278]:   <name>instance-0000000a</name>
Oct 30 10:53:12 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:53:12 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:53:12 user nova-compute[74278]:   <metadata>
Oct 30 10:53:12 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:53:12 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:53:12 user nova-compute[74278]:       <nova:name>tempest-device-tagging-server-236877004</nova:name>
Oct 30 10:53:12 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:53:07</nova:creationTime>
Oct 30 10:53:12 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:53:12 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:53:12 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:53:12 user nova-compute[74278]:       <nova:owner>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:user uuid="ca01d5bb5fed4d10a71dc75a9b84cce5">tempest-TaggedBootDevicesTest-1464307696-project-member</nova:user>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:project uuid="ede4e1a736e44d34b20ff87b3080c98f">tempest-TaggedBootDevicesTest-1464307696</nova:project>
Oct 30 10:53:12 user nova-compute[74278]:       </nova:owner>
Oct 30 10:53:12 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:53:12 user nova-compute[74278]:       <nova:ports>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:port uuid="edff675c-acda-4742-ad07-9d0467793110">
Oct 30 10:53:12 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 10:53:12 user nova-compute[74278]:         </nova:port>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:port uuid="04dc9645-4e3f-4ea7-9f9f-67d4b1df3688">
Oct 30 10:53:12 user nova-compute[74278]:           <nova:ip type="fixed" address="10.1.1.204" ipVersion="4"/>
Oct 30 10:53:12 user nova-compute[74278]:         </nova:port>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:port uuid="f86eed54-e62f-496b-9a5f-ed15fb77dd3c">
Oct 30 10:53:12 user nova-compute[74278]:           <nova:ip type="fixed" address="10.1.1.129" ipVersion="4"/>
Oct 30 10:53:12 user nova-compute[74278]:         </nova:port>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:port uuid="64a18b70-db46-4f6e-825f-402681eca643">
Oct 30 10:53:12 user nova-compute[74278]:           <nova:ip type="fixed" address="10.1.1.238" ipVersion="4"/>
Oct 30 10:53:12 user nova-compute[74278]:         </nova:port>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:port uuid="67ab7040-7f2b-4b2f-acb6-afa9d70c94ff">
Oct 30 10:53:12 user nova-compute[74278]:           <nova:ip type="fixed" address="10.1.1.40" ipVersion="4"/>
Oct 30 10:53:12 user nova-compute[74278]:         </nova:port>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:port uuid="65829325-bf17-46c2-b8b3-8eba21130ce1">
Oct 30 10:53:12 user nova-compute[74278]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 30 10:53:12 user nova-compute[74278]:         </nova:port>
Oct 30 10:53:12 user nova-compute[74278]:         <nova:port uuid="c65bf1e5-c95f-473e-9452-fc6ff873d709">
Oct 30 10:53:12 user nova-compute[74278]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 30 10:53:12 user nova-compute[74278]:         </nova:port>
Oct 30 10:53:12 user nova-compute[74278]:       </nova:ports>
Oct 30 10:53:12 user nova-compute[74278]:     </nova:instance>
Oct 30 10:53:12 user nova-compute[74278]:   </metadata>
Oct 30 10:53:12 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:53:12 user nova-compute[74278]:     <system>
Oct 30 10:53:12 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:53:12 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:53:12 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:53:12 user nova-compute[74278]:       <entry name="serial">3c26a595-b269-44b0-bf02-43b6b768183e</entry>
Oct 30 10:53:12 user nova-compute[74278]:       <entry name="uuid">3c26a595-b269-44b0-bf02-43b6b768183e</entry>
Oct 30 10:53:12 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:53:12 user nova-compute[74278]:     </system>
Oct 30 10:53:12 user nova-compute[74278]:   </sysinfo>
Oct 30 10:53:12 user nova-compute[74278]:   <os>
Oct 30 10:53:12 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:53:12 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:53:12 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:53:12 user nova-compute[74278]:   </os>
Oct 30 10:53:12 user nova-compute[74278]:   <features>
Oct 30 10:53:12 user nova-compute[74278]:     <acpi/>
Oct 30 10:53:12 user nova-compute[74278]:     <apic/>
Oct 30 10:53:12 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:53:12 user nova-compute[74278]:   </features>
Oct 30 10:53:12 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:53:12 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:53:12 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:53:12 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:53:12 user nova-compute[74278]:   </clock>
Oct 30 10:53:12 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:53:12 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:53:12 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:53:12 user nova-compute[74278]:   </cpu>
Oct 30 10:53:12 user nova-compute[74278]:   <devices>
Oct 30 10:53:12 user nova-compute[74278]:     <disk type="file" device="cdrom">
Oct 30 10:53:12 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none"/>
Oct 30 10:53:12 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/3c26a595-b269-44b0-bf02-43b6b768183e/disk.config"/>
Oct 30 10:53:12 user nova-compute[74278]:       <target dev="hda" bus="ide"/>
Oct 30 10:53:12 user nova-compute[74278]:     </disk>
Oct 30 10:53:12 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 10:53:12 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:12 user nova-compute[74278]:       <source dev="/dev/sdc"/>
Oct 30 10:53:12 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:53:12 user nova-compute[74278]:       <serial>3b4bf1cf-571a-47d2-b86c-75e5e4210b47</serial>
Oct 30 10:53:12 user nova-compute[74278]:     </disk>
Oct 30 10:53:12 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 10:53:12 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:12 user nova-compute[74278]:       <source dev="/dev/sdd"/>
Oct 30 10:53:12 user nova-compute[74278]:       <target dev="vdb" bus="virtio"/>
Oct 30 10:53:12 user nova-compute[74278]:       <serial>7e841c31-e573-410b-b282-1810a83a99e3</serial>
Oct 30 10:53:12 user nova-compute[74278]:     </disk>
Oct 30 10:53:12 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 10:53:12 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:12 user nova-compute[74278]:       <source dev="/dev/sde"/>
Oct 30 10:53:12 user nova-compute[74278]:       <target dev="vdc" bus="virtio"/>
Oct 30 10:53:12 user nova-compute[74278]:       <serial>352a4886-2b5c-478c-bddb-47be3ae313db</serial>
Oct 30 10:53:12 user nova-compute[74278]:     </disk>
Oct 30 10:53:12 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:53:12 user nova-compute[74278]:       <mac address="fa:16:3e:b3:fb:38"/>
Oct 30 10:53:12 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:53:12 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:53:12 user nova-compute[74278]:       <target dev="tapedff675c-ac"/>
Oct 30 10:53:12 user nova-compute[74278]:     </interface>
Oct 30 10:53:12 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:53:12 user nova-compute[74278]:       <mac address="fa:16:3e:19:4a:9e"/>
Oct 30 10:53:12 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:53:12 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:53:12 user nova-compute[74278]:       <target dev="tap04dc9645-4e"/>
Oct 30 10:53:12 user nova-compute[74278]:     </interface>
Oct 30 10:53:12 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:53:12 user nova-compute[74278]:       <mac address="fa:16:3e:ea:37:63"/>
Oct 30 10:53:12 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:53:12 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:53:12 user nova-compute[74278]:       <target dev="tapf86eed54-e6"/>
Oct 30 10:53:12 user nova-compute[74278]:     </interface>
Oct 30 10:53:12 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:53:12 user nova-compute[74278]:       <mac address="fa:16:3e:e1:8b:ad"/>
Oct 30 10:53:12 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:53:12 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:53:12 user nova-compute[74278]:       <target dev="tap64a18b70-db"/>
Oct 30 10:53:12 user nova-compute[74278]:     </interface>
Oct 30 10:53:12 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:53:12 user nova-compute[74278]:       <mac address="fa:16:3e:04:22:22"/>
Oct 30 10:53:12 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:53:12 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:53:12 user nova-compute[74278]:       <target dev="tap67ab7040-7f"/>
Oct 30 10:53:12 user nova-compute[74278]:     </interface>
Oct 30 10:53:12 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:53:12 user nova-compute[74278]:       <mac address="fa:16:3e:14:db:ba"/>
Oct 30 10:53:12 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:53:12 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:53:12 user nova-compute[74278]:       <target dev="tap65829325-bf"/>
Oct 30 10:53:12 user nova-compute[74278]:     </interface>
Oct 30 10:53:12 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:53:12 user nova-compute[74278]:       <mac address="fa:16:3e:c5:a5:25"/>
Oct 30 10:53:12 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:53:12 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:53:12 user nova-compute[74278]:       <target dev="tapc65bf1e5-c9"/>
Oct 30 10:53:12 user nova-compute[74278]:     </interface>
Oct 30 10:53:12 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:53:12 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/3c26a595-b269-44b0-bf02-43b6b768183e/console.log" append="off"/>
Oct 30 10:53:12 user nova-compute[74278]:     </serial>
Oct 30 10:53:12 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:53:12 user nova-compute[74278]:     <video>
Oct 30 10:53:12 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:53:12 user nova-compute[74278]:     </video>
Oct 30 10:53:12 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:53:12 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:53:12 user nova-compute[74278]:     </rng>
Oct 30 10:53:12 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:53:12 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:53:12 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:53:12 user nova-compute[74278]:     </memballoon>
Oct 30 10:53:12 user nova-compute[74278]:   </devices>
Oct 30 10:53:12 user nova-compute[74278]: </domain>
Oct 30 10:53:12 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edff675c-acda-4742-ad07-9d0467793110", "address": "fa:16:3e:b3:fb:38", "network": {"id": "19ff6d4c-75b3-458e-b3de-078a13b43272", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-53728059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff675c-ac", "ovs_interfaceid": "edff675c-acda-4742-ad07-9d0467793110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "edff675c-acda-4742-ad07-9d0467793110", "address": "fa:16:3e:b3:fb:38", "network": {"id": "19ff6d4c-75b3-458e-b3de-078a13b43272", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-53728059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff675c-ac", "ovs_interfaceid": "edff675c-acda-4742-ad07-9d0467793110", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:fb:38,bridge_name='br-int',has_traffic_filtering=True,id=edff675c-acda-4742-ad07-9d0467793110,network=Network(19ff6d4c-75b3-458e-b3de-078a13b43272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff675c-ac') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:fb:38,bridge_name='br-int',has_traffic_filtering=True,id=edff675c-acda-4742-ad07-9d0467793110,network=Network(19ff6d4c-75b3-458e-b3de-078a13b43272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff675c-ac') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'beb8a552-70a9-51c1-9622-cc4f4ad71297', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedff675c-ac, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedff675c-ac, col_values=(('qos', UUID('30a6809e-729e-4be4-a16c-2f9fa472f752')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedff675c-ac, col_values=(('external_ids', {'iface-id': 'edff675c-acda-4742-ad07-9d0467793110', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:fb:38', 'vm-uuid': '3c26a595-b269-44b0-bf02-43b6b768183e'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: INFO os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:fb:38,bridge_name='br-int',has_traffic_filtering=True,id=edff675c-acda-4742-ad07-9d0467793110,network=Network(19ff6d4c-75b3-458e-b3de-078a13b43272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff675c-ac')
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:4a:9e,bridge_name='br-int',has_traffic_filtering=True,id=04dc9645-4e3f-4ea7-9f9f-67d4b1df3688,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04dc9645-4e') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:4a:9e,bridge_name='br-int',has_traffic_filtering=True,id=04dc9645-4e3f-4ea7-9f9f-67d4b1df3688,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04dc9645-4e') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdd62ba2-60f5-53ec-96b9-729f2d6de089', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04dc9645-4e, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04dc9645-4e, col_values=(('qos', UUID('516511e0-4c20-4852-aa77-ae22f176ff82')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04dc9645-4e, col_values=(('external_ids', {'iface-id': '04dc9645-4e3f-4ea7-9f9f-67d4b1df3688', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:4a:9e', 'vm-uuid': '3c26a595-b269-44b0-bf02-43b6b768183e'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: INFO os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:4a:9e,bridge_name='br-int',has_traffic_filtering=True,id=04dc9645-4e3f-4ea7-9f9f-67d4b1df3688,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04dc9645-4e')
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:37:63,bridge_name='br-int',has_traffic_filtering=True,id=f86eed54-e62f-496b-9a5f-ed15fb77dd3c,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf86eed54-e6') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:37:63,bridge_name='br-int',has_traffic_filtering=True,id=f86eed54-e62f-496b-9a5f-ed15fb77dd3c,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf86eed54-e6') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09181e99-f29f-5cba-aead-d937a8b3874e', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf86eed54-e6, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf86eed54-e6, col_values=(('qos', UUID('3c18415c-899c-49be-aa9d-62a799be6ee4')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf86eed54-e6, col_values=(('external_ids', {'iface-id': 'f86eed54-e62f-496b-9a5f-ed15fb77dd3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:37:63', 'vm-uuid': '3c26a595-b269-44b0-bf02-43b6b768183e'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: INFO os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:37:63,bridge_name='br-int',has_traffic_filtering=True,id=f86eed54-e62f-496b-9a5f-ed15fb77dd3c,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf86eed54-e6')
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8b:ad,bridge_name='br-int',has_traffic_filtering=True,id=64a18b70-db46-4f6e-825f-402681eca643,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a18b70-db') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8b:ad,bridge_name='br-int',has_traffic_filtering=True,id=64a18b70-db46-4f6e-825f-402681eca643,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a18b70-db') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00b17605-8762-5751-99ea-3c29af6bc2b0', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.policy [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31e7e6847ec0415fba0fd909c014e802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43bf73deda348f08290daf640768705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:53:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Creating image(s)
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "/opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "/opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64a18b70-db, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64a18b70-db, col_values=(('qos', UUID('770b500a-daca-4f6c-a0fa-3edcb49ffc35')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64a18b70-db, col_values=(('external_ids', {'iface-id': '64a18b70-db46-4f6e-825f-402681eca643', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:8b:ad', 'vm-uuid': '3c26a595-b269-44b0-bf02-43b6b768183e'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: INFO os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8b:ad,bridge_name='br-int',has_traffic_filtering=True,id=64a18b70-db46-4f6e-825f-402681eca643,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a18b70-db')
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:22:22,bridge_name='br-int',has_traffic_filtering=True,id=67ab7040-7f2b-4b2f-acb6-afa9d70c94ff,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab7040-7f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:22:22,bridge_name='br-int',has_traffic_filtering=True,id=67ab7040-7f2b-4b2f-acb6-afa9d70c94ff,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab7040-7f') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0b7307a-cd06-552c-8681-afadb3e00139', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67ab7040-7f, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67ab7040-7f, col_values=(('qos', UUID('d63c8baf-6663-4780-b551-04a56a0f4b6d')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67ab7040-7f, col_values=(('external_ids', {'iface-id': '67ab7040-7f2b-4b2f-acb6-afa9d70c94ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:22:22', 'vm-uuid': '3c26a595-b269-44b0-bf02-43b6b768183e'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: INFO os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:22:22,bridge_name='br-int',has_traffic_filtering=True,id=67ab7040-7f2b-4b2f-acb6-afa9d70c94ff,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab7040-7f')
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:ba,bridge_name='br-int',has_traffic_filtering=True,id=65829325-bf17-46c2-b8b3-8eba21130ce1,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65829325-bf') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:ba,bridge_name='br-int',has_traffic_filtering=True,id=65829325-bf17-46c2-b8b3-8eba21130ce1,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65829325-bf') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6248959d-538b-5631-a6fb-c02824b95929', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.221s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65829325-bf, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65829325-bf, col_values=(('qos', UUID('cb210759-0644-46bd-9205-bc7dec3252ff')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65829325-bf, col_values=(('external_ids', {'iface-id': '65829325-bf17-46c2-b8b3-8eba21130ce1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:db:ba', 'vm-uuid': '3c26a595-b269-44b0-bf02-43b6b768183e'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: INFO os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:ba,bridge_name='br-int',has_traffic_filtering=True,id=65829325-bf17-46c2-b8b3-8eba21130ce1,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65829325-bf')
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:25,bridge_name='br-int',has_traffic_filtering=True,id=c65bf1e5-c95f-473e-9452-fc6ff873d709,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc65bf1e5-c9') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:25,bridge_name='br-int',has_traffic_filtering=True,id=c65bf1e5-c95f-473e-9452-fc6ff873d709,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc65bf1e5-c9') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7f65666-a30b-5181-a22e-58503e147d2d', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc65bf1e5-c9, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc65bf1e5-c9, col_values=(('qos', UUID('95024141-0af8-40d1-b378-262fac83318d')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc65bf1e5-c9, col_values=(('external_ids', {'iface-id': 'c65bf1e5-c95f-473e-9452-fc6ff873d709', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:a5:25', 'vm-uuid': '3c26a595-b269-44b0-bf02-43b6b768183e'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.239s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:13 user nova-compute[74278]: INFO os_vif [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:25,bridge_name='br-int',has_traffic_filtering=True,id=c65bf1e5-c95f-473e-9452-fc6ff873d709,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc65bf1e5-c9')
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk 1073741824" returned: 0 in 0.088s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] No BDM found with device name hda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] No VIF found with MAC fa:16:3e:b3:fb:38, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] No VIF found with MAC fa:16:3e:04:22:22, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:53:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Using config drive
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.193s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:53:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Cannot resize image /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Ensure instance console log exists: /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:14 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Creating config drive at /opt/stack/data/nova/instances/3c26a595-b269-44b0-bf02-43b6b768183e/disk.config
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3c26a595-b269-44b0-bf02-43b6b768183e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl02bmvg6 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Successfully created port: 982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3c26a595-b269-44b0-bf02-43b6b768183e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl02bmvg6" returned: 0 in 0.064s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYdWEfBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:14 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:14 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:14 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade1a2a1-81a7-4d5a-91bf-3363c5c6170a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:53:14 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2882ae1d-a1aa-42e0-ab3c-c01d4baa6d98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985] added
Oct 30 10:53:14 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bde498a-3110-4684-b8c6-2644d6cd17f1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[76974ff8-85d3-4e01-825e-afa8318c62ce]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYdWEfBN {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYdWEfBN" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8897c8-e3a9-4f2f-8752-112b4824c492]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYdWEfBN'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf0a902-29ea-43dc-8dfe-a7fa151dacf2]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8f56cb-18d0-4fdf-a129-f45c4f3c0fed]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:14 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:14 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[11124b07-9f9e-425d-b7db-1ce001ddedca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985, portal: 172.16.0.220,3260]
Oct 30 10:53:14 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985, portal: 172.16.0.220,3260] successful.
Oct 30 10:53:14 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03f266e-aae5-4bf0-8ca8-5a7e6532c003]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[39293c28-7836-4398-808f-d4443d6b451a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:14 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:14 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d578ce5-6d3c-4dee-bd6f-5ed7fe140b93]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Successfully updated port: 982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "refresh_cache-9b6f739d-461c-48a4-a4a7-5eebbca38913" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquired lock "refresh_cache-9b6f739d-461c-48a4-a4a7-5eebbca38913" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-a2e19549-ea28-47d3-b015-515c3a33f1f6 req-139e1673-3826-4ffe-9b7d-304c64e60e9b service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Received event network-changed-982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-a2e19549-ea28-47d3-b015-515c3a33f1f6 req-139e1673-3826-4ffe-9b7d-304c64e60e9b service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Refreshing instance network info cache due to event network-changed-982a753c-a6ca-4884-b3ac-9f6769b439cd. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:53:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a2e19549-ea28-47d3-b015-515c3a33f1f6 req-139e1673-3826-4ffe-9b7d-304c64e60e9b service nova] Acquiring lock "refresh_cache-9b6f739d-461c-48a4-a4a7-5eebbca38913" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uImbdfht', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:15 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Updating instance_info_cache with network_info: [{"id": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "address": "fa:16:3e:a3:cf:76", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982a753c-a6", "ovs_interfaceid": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Releasing lock "refresh_cache-9b6f739d-461c-48a4-a4a7-5eebbca38913" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Instance network_info: |[{"id": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "address": "fa:16:3e:a3:cf:76", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982a753c-a6", "ovs_interfaceid": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a2e19549-ea28-47d3-b015-515c3a33f1f6 req-139e1673-3826-4ffe-9b7d-304c64e60e9b service nova] Acquired lock "refresh_cache-9b6f739d-461c-48a4-a4a7-5eebbca38913" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-a2e19549-ea28-47d3-b015-515c3a33f1f6 req-139e1673-3826-4ffe-9b7d-304c64e60e9b service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Refreshing network info cache for port 982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Start _get_guest_xml network_info=[{"id": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "address": "fa:16:3e:a3:cf:76", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982a753c-a6", "ovs_interfaceid": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:53:15 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:53:15 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1698872011',display_name='tempest-AttachVolumeNegativeTest-server-1698872011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1698872011',id=12,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZVtk53JwaPS4EIOyoVQ4n/bA3xAPmJaHS0gcNvltHjytUPlVScP3tZhAkvZUyXydAUyN7jkAoNB2dBxmHjnuoSo1FRRnmc90BBpmgh98oOpFyyK14YE+N6L+J5DJO60A==',key_name='tempest-keypair-912609621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43bf73deda348f08290daf640768705',ramdisk_id='',reservation_id='r-5352n706',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-871157650',owner_user_name='tempest-AttachVolumeNegativeTest-871157650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:53:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31e7e6847ec0415fba0fd909c014e802',uuid=9b6f739d-461c-48a4-a4a7-5eebbca38913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "address": "fa:16:3e:a3:cf:76", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982a753c-a6", "ovs_interfaceid": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converting VIF {"id": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "address": "fa:16:3e:a3:cf:76", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982a753c-a6", "ovs_interfaceid": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:cf:76,bridge_name='br-int',has_traffic_filtering=True,id=982a753c-a6ca-4884-b3ac-9f6769b439cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982a753c-a6') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b6f739d-461c-48a4-a4a7-5eebbca38913 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:53:15 user nova-compute[74278]:   <uuid>9b6f739d-461c-48a4-a4a7-5eebbca38913</uuid>
Oct 30 10:53:15 user nova-compute[74278]:   <name>instance-0000000c</name>
Oct 30 10:53:15 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:53:15 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:53:15 user nova-compute[74278]:   <metadata>
Oct 30 10:53:15 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:53:15 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:53:15 user nova-compute[74278]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1698872011</nova:name>
Oct 30 10:53:15 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:53:15</nova:creationTime>
Oct 30 10:53:15 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:53:15 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:53:15 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:53:15 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:53:15 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:53:15 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:53:15 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:53:15 user nova-compute[74278]:       <nova:owner>
Oct 30 10:53:15 user nova-compute[74278]:         <nova:user uuid="31e7e6847ec0415fba0fd909c014e802">tempest-AttachVolumeNegativeTest-871157650-project-member</nova:user>
Oct 30 10:53:15 user nova-compute[74278]:         <nova:project uuid="b43bf73deda348f08290daf640768705">tempest-AttachVolumeNegativeTest-871157650</nova:project>
Oct 30 10:53:15 user nova-compute[74278]:       </nova:owner>
Oct 30 10:53:15 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:53:15 user nova-compute[74278]:       <nova:ports>
Oct 30 10:53:15 user nova-compute[74278]:         <nova:port uuid="982a753c-a6ca-4884-b3ac-9f6769b439cd">
Oct 30 10:53:15 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 30 10:53:15 user nova-compute[74278]:         </nova:port>
Oct 30 10:53:15 user nova-compute[74278]:       </nova:ports>
Oct 30 10:53:15 user nova-compute[74278]:     </nova:instance>
Oct 30 10:53:15 user nova-compute[74278]:   </metadata>
Oct 30 10:53:15 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:53:15 user nova-compute[74278]:     <system>
Oct 30 10:53:15 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:53:15 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:53:15 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:53:15 user nova-compute[74278]:       <entry name="serial">9b6f739d-461c-48a4-a4a7-5eebbca38913</entry>
Oct 30 10:53:15 user nova-compute[74278]:       <entry name="uuid">9b6f739d-461c-48a4-a4a7-5eebbca38913</entry>
Oct 30 10:53:15 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:53:15 user nova-compute[74278]:     </system>
Oct 30 10:53:15 user nova-compute[74278]:   </sysinfo>
Oct 30 10:53:15 user nova-compute[74278]:   <os>
Oct 30 10:53:15 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:53:15 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:53:15 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:53:15 user nova-compute[74278]:   </os>
Oct 30 10:53:15 user nova-compute[74278]:   <features>
Oct 30 10:53:15 user nova-compute[74278]:     <acpi/>
Oct 30 10:53:15 user nova-compute[74278]:     <apic/>
Oct 30 10:53:15 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:53:15 user nova-compute[74278]:   </features>
Oct 30 10:53:15 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:53:15 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:53:15 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:53:15 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:53:15 user nova-compute[74278]:   </clock>
Oct 30 10:53:15 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:53:15 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:53:15 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:53:15 user nova-compute[74278]:   </cpu>
Oct 30 10:53:15 user nova-compute[74278]:   <devices>
Oct 30 10:53:15 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:53:15 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:53:15 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk"/>
Oct 30 10:53:15 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:53:15 user nova-compute[74278]:     </disk>
Oct 30 10:53:15 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:53:15 user nova-compute[74278]:       <mac address="fa:16:3e:a3:cf:76"/>
Oct 30 10:53:15 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:53:15 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:53:15 user nova-compute[74278]:       <target dev="tap982a753c-a6"/>
Oct 30 10:53:15 user nova-compute[74278]:     </interface>
Oct 30 10:53:15 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:53:15 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/console.log" append="off"/>
Oct 30 10:53:15 user nova-compute[74278]:     </serial>
Oct 30 10:53:15 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:53:15 user nova-compute[74278]:     <video>
Oct 30 10:53:15 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:53:15 user nova-compute[74278]:     </video>
Oct 30 10:53:15 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:53:15 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:53:15 user nova-compute[74278]:     </rng>
Oct 30 10:53:15 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:53:15 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:53:15 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:53:15 user nova-compute[74278]:     </memballoon>
Oct 30 10:53:15 user nova-compute[74278]:   </devices>
Oct 30 10:53:15 user nova-compute[74278]: </domain>
Oct 30 10:53:15 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1698872011',display_name='tempest-AttachVolumeNegativeTest-server-1698872011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1698872011',id=12,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZVtk53JwaPS4EIOyoVQ4n/bA3xAPmJaHS0gcNvltHjytUPlVScP3tZhAkvZUyXydAUyN7jkAoNB2dBxmHjnuoSo1FRRnmc90BBpmgh98oOpFyyK14YE+N6L+J5DJO60A==',key_name='tempest-keypair-912609621',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43bf73deda348f08290daf640768705',ramdisk_id='',reservation_id='r-5352n706',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-871157650',owner_user_name='tempest-AttachVolumeNegativeTest-871157650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:53:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31e7e6847ec0415fba0fd909c014e802',uuid=9b6f739d-461c-48a4-a4a7-5eebbca38913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "address": "fa:16:3e:a3:cf:76", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982a753c-a6", "ovs_interfaceid": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converting VIF {"id": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "address": "fa:16:3e:a3:cf:76", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982a753c-a6", "ovs_interfaceid": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:cf:76,bridge_name='br-int',has_traffic_filtering=True,id=982a753c-a6ca-4884-b3ac-9f6769b439cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982a753c-a6') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_vif [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:cf:76,bridge_name='br-int',has_traffic_filtering=True,id=982a753c-a6ca-4884-b3ac-9f6769b439cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982a753c-a6') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89c247a5-0dd3-5c96-8c07-4dbd9e96d6cf', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap982a753c-a6, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap982a753c-a6, col_values=(('qos', UUID('6921ddc2-b68c-45eb-89a8-2457474af39c')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap982a753c-a6, col_values=(('external_ids', {'iface-id': '982a753c-a6ca-4884-b3ac-9f6769b439cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:cf:76', 'vm-uuid': '9b6f739d-461c-48a4-a4a7-5eebbca38913'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:15 user nova-compute[74278]: INFO os_vif [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:cf:76,bridge_name='br-int',has_traffic_filtering=True,id=982a753c-a6ca-4884-b3ac-9f6769b439cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982a753c-a6')
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No VIF found with MAC fa:16:3e:a3:cf:76, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYdWEfBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23330343063346137', 'path': '/dev/sdf'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330343063346137', 'path': '/dev/sdf'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.488s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:15 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:15 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lazy-loading 'flavor' on Instance uuid 0cecb81b-55ae-46de-8f32-433f2ff42bad {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[199c3bab-6ee5-437d-b945-aa3023882618]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:53:15 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 10:53:15 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:15 user nova-compute[74278]:   <source dev="/dev/sdf"/>
Oct 30 10:53:15 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:53:15 user nova-compute[74278]:   <serial>37d70260-b46d-460b-a095-b586c3689985</serial>
Oct 30 10:53:15 user nova-compute[74278]: </disk>
Oct 30 10:53:15 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd3bb1-549e-4980-b7d8-77f97e268fec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c] added
Oct 30 10:53:15 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9602ccf5-d5c0-4b07-ad6c-49d2325eaf16]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[480473a8-7331-4011-bcdc-5610c324b3cf]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uImbdfht {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-a2e19549-ea28-47d3-b015-515c3a33f1f6 req-139e1673-3826-4ffe-9b7d-304c64e60e9b service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Updated VIF entry in instance network info cache for port 982a753c-a6ca-4884-b3ac-9f6769b439cd. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-a2e19549-ea28-47d3-b015-515c3a33f1f6 req-139e1673-3826-4ffe-9b7d-304c64e60e9b service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Updating instance_info_cache with network_info: [{"id": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "address": "fa:16:3e:a3:cf:76", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982a753c-a6", "ovs_interfaceid": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uImbdfht" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a8a48d-c56e-4cb7-a145-0e0298d08275]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uImbdfht'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a2e19549-ea28-47d3-b015-515c3a33f1f6 req-139e1673-3826-4ffe-9b7d-304c64e60e9b service nova] Releasing lock "refresh_cache-9b6f739d-461c-48a4-a4a7-5eebbca38913" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e18ff98-675c-4bc7-aeb1-665762bfa7a6]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6970a6-7756-46a4-81dd-3e14c2726f07]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:15 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:15 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:15 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:15 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:15 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:15 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:15 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:15 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:15 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:15 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9719d7a4-65d0-45e2-8539-b4e9c5767c83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c, portal: 172.16.0.220,3260]
Oct 30 10:53:16 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c, portal: 172.16.0.220,3260] successful.
Oct 30 10:53:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8efece6-68bc-43d6-ad8a-564b232c5219]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ff13fb-ddfb-468f-9ae7-0feec0894bb0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:16 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:16 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:16 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:16 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:16 user nova-compute[74278]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)
Oct 30 10:53:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:16 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:16 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:16 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:16 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:16 user nova-compute[74278]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)
Oct 30 10:53:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[14df8763-af40-4d69-9ac0-b83c6eb004e3]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uImbdfht', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG nova.compute.manager [req-5558df74-f1cd-4ca7-8f6d-92ef90343a8c req-ee8982d3-4dfd-4354-9252-b7f344907cfd service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5558df74-f1cd-4ca7-8f6d-92ef90343a8c req-ee8982d3-4dfd-4354-9252-b7f344907cfd service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5558df74-f1cd-4ca7-8f6d-92ef90343a8c req-ee8982d3-4dfd-4354-9252-b7f344907cfd service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5558df74-f1cd-4ca7-8f6d-92ef90343a8c req-ee8982d3-4dfd-4354-9252-b7f344907cfd service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG nova.compute.manager [req-5558df74-f1cd-4ca7-8f6d-92ef90343a8c req-ee8982d3-4dfd-4354-9252-b7f344907cfd service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:16 user nova-compute[74278]: WARNING nova.compute.manager [req-5558df74-f1cd-4ca7-8f6d-92ef90343a8c req-ee8982d3-4dfd-4354-9252-b7f344907cfd service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-edff675c-acda-4742-ad07-9d0467793110 for instance with vm_state building and task_state spawning.
Oct 30 10:53:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-96676766-2980-465c-8307-19da2334954e req-88d6af2e-6588-4b90-8ad4-bc5503befacd service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-96676766-2980-465c-8307-19da2334954e req-88d6af2e-6588-4b90-8ad4-bc5503befacd service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-96676766-2980-465c-8307-19da2334954e req-88d6af2e-6588-4b90-8ad4-bc5503befacd service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-96676766-2980-465c-8307-19da2334954e req-88d6af2e-6588-4b90-8ad4-bc5503befacd service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-96676766-2980-465c-8307-19da2334954e req-88d6af2e-6588-4b90-8ad4-bc5503befacd service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:17 user nova-compute[74278]: WARNING nova.compute.manager [req-96676766-2980-465c-8307-19da2334954e req-88d6af2e-6588-4b90-8ad4-bc5503befacd service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 for instance with vm_state building and task_state spawning.
Oct 30 10:53:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] <== connect_volume: return (1908ms) {'type': 'block', 'scsi_wwn': '23837623163643865', 'path': '/dev/sdg'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837623163643865', 'path': '/dev/sdg'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG nova.objects.instance [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lazy-loading 'flavor' on Instance uuid 7264e69a-5781-420d-91b4-ab7d494c40ca {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 10:53:17 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:17 user nova-compute[74278]:   <source dev="/dev/sdg"/>
Oct 30 10:53:17 user nova-compute[74278]:   <target dev="sdc" bus="scsi"/>
Oct 30 10:53:17 user nova-compute[74278]:   <serial>d6144d81-50f0-4fd8-8677-96d7ab12f44c</serial>
Oct 30 10:53:17 user nova-compute[74278]:   <address type="drive" controller="0" unit="2"/>
Oct 30 10:53:17 user nova-compute[74278]: </disk>
Oct 30 10:53:17 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] No BDM found with device name hda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] No VIF found with MAC fa:16:3e:ac:42:07, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-55cf7cd9-4e0b-4caa-874e-4963079e3b10" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-55cf7cd9-4e0b-4caa-874e-4963079e3b10" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a4a3d547-d4e5-476a-a234-a08cc77aa3b4 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.025s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] No BDM found with device name sda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] No VIF found with MAC fa:16:3e:5b:71:4c, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:18 user nova-compute[74278]: WARNING nova.compute.manager [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-edff675c-acda-4742-ad07-9d0467793110 for instance with vm_state building and task_state spawning.
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-f86eed54-e62f-496b-9a5f-ed15fb77dd3c {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-f86eed54-e62f-496b-9a5f-ed15fb77dd3c {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:18 user nova-compute[74278]: WARNING nova.compute.manager [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-f86eed54-e62f-496b-9a5f-ed15fb77dd3c for instance with vm_state building and task_state spawning.
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-f86eed54-e62f-496b-9a5f-ed15fb77dd3c {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-f86eed54-e62f-496b-9a5f-ed15fb77dd3c {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:18 user nova-compute[74278]: WARNING nova.compute.manager [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-f86eed54-e62f-496b-9a5f-ed15fb77dd3c for instance with vm_state building and task_state spawning.
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:18 user nova-compute[74278]: WARNING nova.compute.manager [req-50984765-3cbd-4448-9ac7-f1a97d778c0e req-fcf8bd51-3d86-40e9-8df0-47e8f270c3a7 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-64a18b70-db46-4f6e-825f-402681eca643 for instance with vm_state building and task_state spawning.
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Updating instance_info_cache with network_info: [{"id": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "address": "fa:16:3e:59:01:36", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3e969f-e9", "ovs_interfaceid": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-55cf7cd9-4e0b-4caa-874e-4963079e3b10" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2ba9e02b-8ead-4b58-8fa6-a6a205a2c1f9 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.465s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-7160ab36-9405-490e-ac5f-bac12884861e req-3497257c-3df3-40bf-ad64-1de7b338d94e service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7160ab36-9405-490e-ac5f-bac12884861e req-3497257c-3df3-40bf-ad64-1de7b338d94e service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7160ab36-9405-490e-ac5f-bac12884861e req-3497257c-3df3-40bf-ad64-1de7b338d94e service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7160ab36-9405-490e-ac5f-bac12884861e req-3497257c-3df3-40bf-ad64-1de7b338d94e service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-7160ab36-9405-490e-ac5f-bac12884861e req-3497257c-3df3-40bf-ad64-1de7b338d94e service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:19 user nova-compute[74278]: WARNING nova.compute.manager [req-7160ab36-9405-490e-ac5f-bac12884861e req-3497257c-3df3-40bf-ad64-1de7b338d94e service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 for instance with vm_state building and task_state spawning.
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "7264e69a-5781-420d-91b4-ab7d494c40ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:19 user nova-compute[74278]: INFO nova.compute.manager [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Detaching volume d6144d81-50f0-4fd8-8677-96d7ab12f44c
Oct 30 10:53:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-15bd2b3b-d50b-4931-995c-a27003590b0b req-2f01a4a0-66cc-4369-b803-2632b728b80c service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Received event network-vif-plugged-982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-15bd2b3b-d50b-4931-995c-a27003590b0b req-2f01a4a0-66cc-4369-b803-2632b728b80c service nova] Acquiring lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-15bd2b3b-d50b-4931-995c-a27003590b0b req-2f01a4a0-66cc-4369-b803-2632b728b80c service nova] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-15bd2b3b-d50b-4931-995c-a27003590b0b req-2f01a4a0-66cc-4369-b803-2632b728b80c service nova] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-15bd2b3b-d50b-4931-995c-a27003590b0b req-2f01a4a0-66cc-4369-b803-2632b728b80c service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] No waiting events found dispatching network-vif-plugged-982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:19 user nova-compute[74278]: WARNING nova.compute.manager [req-15bd2b3b-d50b-4931-995c-a27003590b0b req-2f01a4a0-66cc-4369-b803-2632b728b80c service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Received unexpected event network-vif-plugged-982a753c-a6ca-4884-b3ac-9f6769b439cd for instance with vm_state building and task_state spawning.
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: INFO nova.virt.block_device [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Attempting to driver detach volume d6144d81-50f0-4fd8-8677-96d7ab12f44c from mountpoint /dev/sdc
Oct 30 10:53:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: INFO nova.compute.manager [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Detaching volume 37d70260-b46d-460b-a095-b586c3689985
Oct 30 10:53:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Attempting to detach device sdc from instance 7264e69a-5781-420d-91b4-ab7d494c40ca from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 10:53:19 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:19 user nova-compute[74278]:   <source dev="/dev/sdg"/>
Oct 30 10:53:19 user nova-compute[74278]:   <target dev="sdc" bus="scsi"/>
Oct 30 10:53:19 user nova-compute[74278]:   <serial>d6144d81-50f0-4fd8-8677-96d7ab12f44c</serial>
Oct 30 10:53:19 user nova-compute[74278]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 30 10:53:19 user nova-compute[74278]: </disk>
Oct 30 10:53:19 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:19 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Successfully detached device sdc from instance 7264e69a-5781-420d-91b4-ab7d494c40ca from the persistent domain config.
Oct 30 10:53:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 7264e69a-5781-420d-91b4-ab7d494c40ca from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 10:53:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 10:53:19 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:19 user nova-compute[74278]:   <source dev="/dev/sdg"/>
Oct 30 10:53:19 user nova-compute[74278]:   <target dev="sdc" bus="scsi"/>
Oct 30 10:53:19 user nova-compute[74278]:   <serial>d6144d81-50f0-4fd8-8677-96d7ab12f44c</serial>
Oct 30 10:53:19 user nova-compute[74278]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 30 10:53:19 user nova-compute[74278]: </disk>
Oct 30 10:53:19 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:53:20 user nova-compute[74278]: INFO nova.virt.block_device [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Attempting to driver detach volume 37d70260-b46d-460b-a095-b586c3689985 from mountpoint /dev/vdb
Oct 30 10:53:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Attempting to detach device vdb from instance 0cecb81b-55ae-46de-8f32-433f2ff42bad from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 10:53:20 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:20 user nova-compute[74278]:   <source dev="/dev/sdf"/>
Oct 30 10:53:20 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:53:20 user nova-compute[74278]:   <serial>37d70260-b46d-460b-a095-b586c3689985</serial>
Oct 30 10:53:20 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 10:53:20 user nova-compute[74278]: </disk>
Oct 30 10:53:20 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:53:20 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Successfully detached device vdb from instance 0cecb81b-55ae-46de-8f32-433f2ff42bad from the persistent domain config.
Oct 30 10:53:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0cecb81b-55ae-46de-8f32-433f2ff42bad from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 10:53:20 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:20 user nova-compute[74278]:   <source dev="/dev/sdf"/>
Oct 30 10:53:20 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:53:20 user nova-compute[74278]:   <serial>37d70260-b46d-460b-a095-b586c3689985</serial>
Oct 30 10:53:20 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 10:53:20 user nova-compute[74278]: </disk>
Oct 30 10:53:20 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:20 user nova-compute[74278]: WARNING nova.compute.manager [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-64a18b70-db46-4f6e-825f-402681eca643 for instance with vm_state building and task_state spawning.
Oct 30 10:53:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:20 user nova-compute[74278]: WARNING nova.compute.manager [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff for instance with vm_state building and task_state spawning.
Oct 30 10:53:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:20 user nova-compute[74278]: WARNING nova.compute.manager [req-d1b45a86-a5db-46c6-ad87-75565d62544a req-23e3e36c-3b24-43bb-afb8-1542b47d1d6b service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff for instance with vm_state building and task_state spawning.
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 7264e69a-5781-420d-91b4-ab7d494c40ca {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0cecb81b-55ae-46de-8f32-433f2ff42bad {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:21 user nova-compute[74278]: WARNING nova.compute.manager [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-65829325-bf17-46c2-b8b3-8eba21130ce1 for instance with vm_state building and task_state spawning.
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:21 user nova-compute[74278]: WARNING nova.compute.manager [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-65829325-bf17-46c2-b8b3-8eba21130ce1 for instance with vm_state building and task_state spawning.
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:21 user nova-compute[74278]: WARNING nova.compute.manager [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-c65bf1e5-c95f-473e-9452-fc6ff873d709 for instance with vm_state building and task_state spawning.
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:21 user nova-compute[74278]: WARNING nova.compute.manager [req-b3acb09c-b477-4761-bceb-14a90b4e73db req-4799d192-0e6b-4672-b38a-f6d8af08d42c service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-c65bf1e5-c95f-473e-9452-fc6ff873d709 for instance with vm_state building and task_state spawning.
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-35da803b-56f7-49bc-ab56-bd4f4285a39f req-311d5c76-d3ea-492d-9b6b-83033d61addc service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Received event network-vif-plugged-982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-35da803b-56f7-49bc-ab56-bd4f4285a39f req-311d5c76-d3ea-492d-9b6b-83033d61addc service nova] Acquiring lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-35da803b-56f7-49bc-ab56-bd4f4285a39f req-311d5c76-d3ea-492d-9b6b-83033d61addc service nova] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-35da803b-56f7-49bc-ab56-bd4f4285a39f req-311d5c76-d3ea-492d-9b6b-83033d61addc service nova] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-35da803b-56f7-49bc-ab56-bd4f4285a39f req-311d5c76-d3ea-492d-9b6b-83033d61addc service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] No waiting events found dispatching network-vif-plugged-982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:21 user nova-compute[74278]: WARNING nova.compute.manager [req-35da803b-56f7-49bc-ab56-bd4f4285a39f req-311d5c76-d3ea-492d-9b6b-83033d61addc service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Received unexpected event network-vif-plugged-982a753c-a6ca-4884-b3ac-9f6769b439cd for instance with vm_state building and task_state spawning.
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:53:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "2591f731-03b7-49b6-93af-c5b63e505127" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:53:22 user nova-compute[74278]: INFO nova.compute.claims [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Claim successful on node user
Oct 30 10:53:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:53:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Instance spawned successfully.
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:53:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Instance spawned successfully.
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:23 user nova-compute[74278]: INFO nova.compute.manager [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Took 10.33 seconds to spawn the instance on the hypervisor.
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:53:23 user nova-compute[74278]: INFO nova.compute.manager [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Took 15.57 seconds to spawn the instance on the hypervisor.
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:53:23 user nova-compute[74278]: INFO nova.compute.manager [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Took 11.65 seconds to build instance.
Oct 30 10:53:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.835s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f9fe0ad-6c18-4495-93b3-39f7b771c56c tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.773s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:23 user nova-compute[74278]: INFO nova.compute.manager [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Took 82.04 seconds to build instance.
Oct 30 10:53:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5a6b232-20c0-4034-bf91-a6f2cc44ce2d tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "3c26a595-b269-44b0-bf02-43b6b768183e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 82.177s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:53:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG nova.policy [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6e338955c2f4d4fae81e9fbf93eff39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6de366be034e23a4d60302674b76c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:53:23 user nova-compute[74278]: INFO nova.virt.block_device [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Booting with blank volume at /dev/vda
Oct 30 10:53:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:24 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Successfully created port: f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:53:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Successfully updated port: f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquired lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG nova.compute.manager [req-3f00dacb-411d-475b-91f4-c775ca995435 req-7412f874-f6ff-40e0-9e02-bb49364e81d4 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-changed-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG nova.compute.manager [req-3f00dacb-411d-475b-91f4-c775ca995435 req-7412f874-f6ff-40e0-9e02-bb49364e81d4 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Refreshing instance network info cache due to event network-changed-f8d17d66-8240-41ca-855d-531672079adb. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3f00dacb-411d-475b-91f4-c775ca995435 req-7412f874-f6ff-40e0-9e02-bb49364e81d4 service nova] Acquiring lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Updating instance_info_cache with network_info: [{"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:53:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Releasing lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:53:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Instance network_info: |[{"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:53:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3f00dacb-411d-475b-91f4-c775ca995435 req-7412f874-f6ff-40e0-9e02-bb49364e81d4 service nova] Acquired lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:53:26 user nova-compute[74278]: DEBUG nova.network.neutron [req-3f00dacb-411d-475b-91f4-c775ca995435 req-7412f874-f6ff-40e0-9e02-bb49364e81d4 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Refreshing network info cache for port f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:53:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:26 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:53:26 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:53:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7341MB free_disk=25.26055145263672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:53:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 55cf7cd9-4e0b-4caa-874e-4963079e3b10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 84448e30-982f-4214-a61e-8cc5e122aef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 7264e69a-5781-420d-91b4-ab7d494c40ca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0cecb81b-55ae-46de-8f32-433f2ff42bad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance d71474f7-0b91-49e5-b03b-56628ae7823e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 3c26a595-b269-44b0-bf02-43b6b768183e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 3d06fffa-bbb3-4853-8fad-b2e3ea89607c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9b6f739d-461c-48a4-a4a7-5eebbca38913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.network.neutron [req-3f00dacb-411d-475b-91f4-c775ca995435 req-7412f874-f6ff-40e0-9e02-bb49364e81d4 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Updated VIF entry in instance network info cache for port f8d17d66-8240-41ca-855d-531672079adb. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.network.neutron [req-3f00dacb-411d-475b-91f4-c775ca995435 req-7412f874-f6ff-40e0-9e02-bb49364e81d4 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Updating instance_info_cache with network_info: [{"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3f00dacb-411d-475b-91f4-c775ca995435 req-7412f874-f6ff-40e0-9e02-bb49364e81d4 service nova] Releasing lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:53:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.846s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:53:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:53:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zORHYMeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:34 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:34 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:34 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:53:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a9aea2-09f1-45a1-8be9-00721a3a2f25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:53:34 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[312d910a-ee78-40d9-98ba-866ee846b0fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7] added
Oct 30 10:53:34 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c143b7-8ea0-4929-9b9b-29878bf37777]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe12e84e-d2f6-4263-8cd9-39e7001a5023]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zORHYMeX {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zORHYMeX" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50e4244-a5cf-47a3-ae40-58bc9c7d3f29]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zORHYMeX'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6c6d4d-c92d-43fe-a146-4ba540ce0c83]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eca492a-7a70-4957-a30b-41dcab64ab4a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)
Oct 30 10:53:35 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)
Oct 30 10:53:35 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.utils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[480b4174-5937-4158-864f-665982ec2c74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[de75abf7-6969-42a6-941a-992f12ddd0bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7, portal: 172.16.0.220,3260]
Oct 30 10:53:35 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7, portal: 172.16.0.220,3260] successful.
Oct 30 10:53:35 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b323ea-8ae9-44b6-bfc7-021ea234f886]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1f7272-1af3-41b5-8ef6-5a8600bcf0c1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0703f98a-70fa-45ff-ae6c-59be67c9f75d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc76077f-179e-49d5-832c-9bb491bb65f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cd6162-a1ae-4bf1-9d45-f6ce78d66c8e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)
Oct 30 10:53:35 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:53:35 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.475s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:53:35 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b036922-dba5-4404-8351-e103913abd7d]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.utils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Updating existing volume attachment record: faa30bfb-945e-4a6a-94fa-d89a1a6d3e73 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[88553b92-a5b7-419c-af63-ec0654cdd11f]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zORHYMeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:53:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.533s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] <== connect_volume: return (1536ms) {'type': 'block', 'scsi_wwn': '23161626333376436', 'path': '/dev/sdh'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:53:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161626333376436', 'path': '/dev/sdh'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:53:36 user nova-compute[74278]: DEBUG nova.objects.instance [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lazy-loading 'flavor' on Instance uuid d71474f7-0b91-49e5-b03b-56628ae7823e {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] attach device xml: <disk type="block" device="disk">
Oct 30 10:53:36 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:36 user nova-compute[74278]:   <source dev="/dev/sdh"/>
Oct 30 10:53:36 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:53:36 user nova-compute[74278]:   <serial>68b5dc17-836e-42da-a452-fe506684eda7</serial>
Oct 30 10:53:36 user nova-compute[74278]: </disk>
Oct 30 10:53:36 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 10:53:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:53:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:53:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] No VIF found with MAC fa:16:3e:81:3f:49, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:53:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6e142751-e97d-4b04-90c5-4eefd6c001b6 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.954s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5305883e-ed4a-46ef-8c60-4f33a4f581b5 tempest-VolumesAssistedSnapshotsTest-710035078 tempest-VolumesAssistedSnapshotsTest-710035078-project] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] volume_snapshot_create: create_info: {'snapshot_id': '17799cb5-b16f-468c-baf0-237ee6a920d5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74278) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 30 10:53:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5305883e-ed4a-46ef-8c60-4f33a4f581b5 tempest-VolumesAssistedSnapshotsTest-710035078 tempest-VolumesAssistedSnapshotsTest-710035078-project] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] snap xml: <domainsnapshot>
Oct 30 10:53:38 user nova-compute[74278]:   <disks>
Oct 30 10:53:38 user nova-compute[74278]:     <disk name="/dev/sdh" snapshot="external" type="file">
Oct 30 10:53:38 user nova-compute[74278]:       <source file="/dev/new_file"/>
Oct 30 10:53:38 user nova-compute[74278]:     </disk>
Oct 30 10:53:38 user nova-compute[74278]:     <disk name="vda" snapshot="no"/>
Oct 30 10:53:38 user nova-compute[74278]:   </disks>
Oct 30 10:53:38 user nova-compute[74278]: </domainsnapshot>
Oct 30 10:53:38 user nova-compute[74278]:  {{(pid=74278) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 30 10:53:38 user nova-compute[74278]: DEBUG nova.objects.instance [None req-5305883e-ed4a-46ef-8c60-4f33a4f581b5 tempest-VolumesAssistedSnapshotsTest-710035078 tempest-VolumesAssistedSnapshotsTest-710035078-project] Lazy-loading 'system_metadata' on Instance uuid d71474f7-0b91-49e5-b03b-56628ae7823e {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:38 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-5305883e-ed4a-46ef-8c60-4f33a4f581b5 tempest-VolumesAssistedSnapshotsTest-710035078 tempest-VolumesAssistedSnapshotsTest-710035078-project] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [None req-5305883e-ed4a-46ef-8c60-4f33a4f581b5 tempest-VolumesAssistedSnapshotsTest-710035078 tempest-VolumesAssistedSnapshotsTest-710035078-project] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Traceback (most recent call last):
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     rv = execute(f, *args, **kwargs)
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     six.reraise(c, e, tb)
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     raise value
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     rv = meth(*args, **kwargs)
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] 
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [None req-5305883e-ed4a-46ef-8c60-4f33a4f581b5 tempest-VolumesAssistedSnapshotsTest-710035078 tempest-VolumesAssistedSnapshotsTest-710035078-project] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Traceback (most recent call last):
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     self._volume_snapshot_create(context, instance, guest,
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     rv = execute(f, *args, **kwargs)
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     six.reraise(c, e, tb)
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     raise value
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     rv = meth(*args, **kwargs)
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] 
Oct 30 10:53:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-7bc62626-7bf8-460d-97de-104686256cd6 tempest-VolumesAssistedSnapshotsTest-710035078 tempest-VolumesAssistedSnapshotsTest-710035078-project] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] volume_snapshot_delete: delete_info: {'volume_id': '68b5dc17-836e-42da-a452-fe506684eda7'} {{(pid=74278) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [None req-7bc62626-7bf8-460d-97de-104686256cd6 tempest-VolumesAssistedSnapshotsTest-710035078 tempest-VolumesAssistedSnapshotsTest-710035078-project] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Traceback (most recent call last):
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e]     if delete_info['type'] != 'qcow2':
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] KeyError: 'type'
Oct 30 10:53:38 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] 
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [None req-5305883e-ed4a-46ef-8c60-4f33a4f581b5 tempest-VolumesAssistedSnapshotsTest-710035078 tempest-VolumesAssistedSnapshotsTest-710035078-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 17799cb5-b16f-468c-baf0-237ee6a920d5 could not be found.
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     raise value
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver 
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver 
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 17799cb5-b16f-468c-baf0-237ee6a920d5 could not be found. (HTTP 404) (Request-ID: req-8d5bccd9-cbc4-4c29-a99a-cab404ce2117)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver 
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver 
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 17799cb5-b16f-468c-baf0-237ee6a920d5 could not be found.
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver 
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server [None req-5305883e-ed4a-46ef-8c60-4f33a4f581b5 tempest-VolumesAssistedSnapshotsTest-710035078 tempest-VolumesAssistedSnapshotsTest-710035078-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     raise value
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server 
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver [None req-7bc62626-7bf8-460d-97de-104686256cd6 tempest-VolumesAssistedSnapshotsTest-710035078 tempest-VolumesAssistedSnapshotsTest-710035078-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver 
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver 
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-c61fb312-6afb-4f91-8898-5607056afa66)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver 
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver 
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 30 10:53:39 user nova-compute[74278]: ERROR nova.virt.libvirt.driver 
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server [None req-7bc62626-7bf8-460d-97de-104686256cd6 tempest-VolumesAssistedSnapshotsTest-710035078 tempest-VolumesAssistedSnapshotsTest-710035078-project] Exception during message handling: KeyError: 'type'
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 30 10:53:39 user nova-compute[74278]: ERROR oslo_messaging.rpc.server 
Oct 30 10:53:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Acquiring lock "d71474f7-0b91-49e5-b03b-56628ae7823e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:39 user nova-compute[74278]: INFO nova.compute.manager [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Detaching volume 68b5dc17-836e-42da-a452-fe506684eda7
Oct 30 10:53:39 user nova-compute[74278]: INFO nova.virt.block_device [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Attempting to driver detach volume 68b5dc17-836e-42da-a452-fe506684eda7 from mountpoint /dev/vdb
Oct 30 10:53:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Attempting to detach device vdb from instance d71474f7-0b91-49e5-b03b-56628ae7823e from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 10:53:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] detach device xml: <disk type="block" device="disk">
Oct 30 10:53:39 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:39 user nova-compute[74278]:   <source dev="/dev/sdh"/>
Oct 30 10:53:39 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:53:39 user nova-compute[74278]:   <serial>68b5dc17-836e-42da-a452-fe506684eda7</serial>
Oct 30 10:53:39 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 10:53:39 user nova-compute[74278]: </disk>
Oct 30 10:53:39 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:53:39 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Successfully detached device vdb from instance d71474f7-0b91-49e5-b03b-56628ae7823e from the persistent domain config.
Oct 30 10:53:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d71474f7-0b91-49e5-b03b-56628ae7823e from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 10:53:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] detach device xml: <disk type="block" device="disk">
Oct 30 10:53:39 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:39 user nova-compute[74278]:   <source dev="/dev/sdh"/>
Oct 30 10:53:39 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:53:39 user nova-compute[74278]:   <serial>68b5dc17-836e-42da-a452-fe506684eda7</serial>
Oct 30 10:53:39 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 10:53:39 user nova-compute[74278]: </disk>
Oct 30 10:53:39 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzOhTEZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:40 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:40 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:40 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f62dc0-2cd3-4b59-b941-c00559bb32bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:53:40 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cf8e89-83a9-479e-b4db-fbfc81835be3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b] added
Oct 30 10:53:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae825eb-b371-415a-82d3-353959ca1932]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e374258d-721a-4489-a85b-99cd5b8cfcbd]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzOhTEZq {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzOhTEZq" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1afd4e2-933c-48fd-ab11-10f77bd63809]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UzOhTEZq'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d71474f7-0b91-49e5-b03b-56628ae7823e {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e49a1c-08bb-49ea-9d8e-1b6b6db1c9ef]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0241c2e-d77a-4276-b5bd-54630674a7a5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1debd5-d77d-4610-901f-90a53ca71289]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b, portal: 172.16.0.220,3260]
Oct 30 10:53:40 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b, portal: 172.16.0.220,3260] successful.
Oct 30 10:53:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d096eb3-0ff1-4dbc-a08a-66c4acb2d231]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1047ac-999f-41d3-8a46-00a203487ca8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)
Oct 30 10:53:40 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:53:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef50d6d-e4b5-4885-ad61-2424b4b37bbf]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:40 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 7264e69a-5781-420d-91b4-ab7d494c40ca is timed out.
Oct 30 10:53:40 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Successfully detached device sdc from instance 7264e69a-5781-420d-91b4-ab7d494c40ca from the live domain config.
Oct 30 10:53:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uImbdfht', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:40 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:41 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0cecb81b-55ae-46de-8f32-433f2ff42bad is timed out.
Oct 30 10:53:41 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Successfully detached device vdb from instance 0cecb81b-55ae-46de-8f32-433f2ff42bad from the live domain config.
Oct 30 10:53:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYdWEfBN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:41 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzOhTEZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23163333331613166', 'path': '/dev/sdi'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163333331613166', 'path': '/dev/sdi'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.549s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lazy-loading 'flavor' on Instance uuid 21d2a8cc-39ee-435e-9936-d1585a9386b7 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[691dc407-7ef4-498a-8979-0a7e521a38ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:53:41 user nova-compute[74278]: No targets found.
Oct 30 10:53:41 user nova-compute[74278]: iSNS:
Oct 30 10:53:41 user nova-compute[74278]: No targets found.
Oct 30 10:53:41 user nova-compute[74278]: STATIC:
Oct 30 10:53:41 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7
Oct 30 10:53:41 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:41 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:41 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b
Oct 30 10:53:41 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:41 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:41 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db
Oct 30 10:53:41 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:41 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:41 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c
Oct 30 10:53:41 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:41 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:41 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985
Oct 30 10:53:41 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:41 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:41 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3
Oct 30 10:53:41 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:41 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:41 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6
Oct 30 10:53:41 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:41 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:41 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47
Oct 30 10:53:41 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:41 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:41 user nova-compute[74278]: FIRMWARE:
Oct 30 10:53:41 user nova-compute[74278]: No targets found.
Oct 30 10:53:41 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:53:41 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:53:41 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 10:53:41 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:41 user nova-compute[74278]:   <source dev="/dev/sdi"/>
Oct 30 10:53:41 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:53:41 user nova-compute[74278]:   <serial>7335b8f1-2594-4f56-a717-bc2f9b1c6a4b</serial>
Oct 30 10:53:41 user nova-compute[74278]: </disk>
Oct 30 10:53:41 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dd9ce0-4d0e-4c23-aa99-c39ef4038679]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb90e33-88df-40b8-9329-453017a7640d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:53:41 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c (non-flash)
Oct 30 10:53:41 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:53:41 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac19e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c'): ({'sdg'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Removing single pathed devices sdg {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[31baa75b-aca5-4867-9f75-c465fbda4d78]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eb4f88-ec74-439c-918f-26b74dc772ca]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Flushing IO for device /dev/sdg {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0a2fb1-bba5-4477-9445-5e280116cc29]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d4b82b-4173-486d-8374-be0955af5ac1]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] SCSI volumes sdg have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8784cd1a-3fcc-409c-8d85-d9aa8d7c8428]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --logout" returned: 0 in 0.199s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3f5f33-79d1-4458-9c25-3286ed3f3f32]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c, portal: 172.16.0.220,3260]
Oct 30 10:53:41 user nova-compute[74278]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c, portal: 172.16.0.220,3260] successful.
Oct 30 10:53:41 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6144d81-50f0-4fd8-8677-96d7ab12f44c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8c8398-f475-417a-91b4-b1d1e7fc3452]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.512s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] <== disconnect_volume: return (1060ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.702s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.129s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1d4c77-2098-488e-a515-ee2d68c3a834]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:53:42 user nova-compute[74278]: No targets found.
Oct 30 10:53:42 user nova-compute[74278]: iSNS:
Oct 30 10:53:42 user nova-compute[74278]: No targets found.
Oct 30 10:53:42 user nova-compute[74278]: STATIC:
Oct 30 10:53:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7
Oct 30 10:53:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b
Oct 30 10:53:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db
Oct 30 10:53:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985
Oct 30 10:53:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3
Oct 30 10:53:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6
Oct 30 10:53:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47
Oct 30 10:53:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:53:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:53:42 user nova-compute[74278]: FIRMWARE:
Oct 30 10:53:42 user nova-compute[74278]: No targets found.
Oct 30 10:53:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:53:42 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:53:42 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d201dc0f-043e-4398-a366-61864e0d4677]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] No VIF found with MAC fa:16:3e:d1:b8:2b, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5699826d-ea34-4d5f-8d71-9bf1053509e1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:53:42 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:42 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:42 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:42 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:42 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:42 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:53:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:53:42 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:53:42 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:53:42 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:53:42 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:53:42 user nova-compute[74278]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 (non-flash)
Oct 30 10:53:42 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:53:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac13dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985'): ({'sdf'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Removing single pathed devices sdf {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[074fa2cc-9de7-4c3f-a926-b3184df3657b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b1ac6a-3759-4aa7-9350-b441cf30a31c]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Flushing IO for device /dev/sdf {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b0b9db-3270-43c2-8920-54252e1ecba3]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[40177d61-1b77-48c3-b1a1-c71bab793b7b]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] SCSI volumes sdf have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8513d091-bf2e-4d8b-ba37-574ee256ad37 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.770s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26fdf83-ff65-4d25-a15d-8337890c569b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fae5e14-0ade-43ba-a1d8-9017f5c4f1d0]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985, portal: 172.16.0.220,3260]
Oct 30 10:53:42 user nova-compute[74278]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985, portal: 172.16.0.220,3260] successful.
Oct 30 10:53:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37d70260-b46d-460b-a095-b586c3689985 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[397bb467-0fff-498f-a545-e92e89f63a5b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] <== disconnect_volume: return (1175ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:53:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:53:43 user nova-compute[74278]: DEBUG nova.objects.instance [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lazy-loading 'flavor' on Instance uuid 7264e69a-5781-420d-91b4-ab7d494c40ca {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-3b91f2f7-953d-4c01-89df-09c591799797 tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.832s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:43 user nova-compute[74278]: DEBUG nova.objects.instance [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lazy-loading 'flavor' on Instance uuid 0cecb81b-55ae-46de-8f32-433f2ff42bad {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7660abc9-bd1a-4109-9ff0-eabdbe5c7a87 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.997s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "7264e69a-5781-420d-91b4-ab7d494c40ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:44 user nova-compute[74278]: INFO nova.compute.manager [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Terminating instance
Oct 30 10:53:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:44 user nova-compute[74278]: INFO nova.compute.manager [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Detaching volume 7335b8f1-2594-4f56-a717-bc2f9b1c6a4b
Oct 30 10:53:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-b9c8069f-1485-4542-a7b4-f0fc48b7dfdb req-21057969-3227-4d55-9e40-20740d2e9cbd service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Received event network-vif-unplugged-101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b9c8069f-1485-4542-a7b4-f0fc48b7dfdb req-21057969-3227-4d55-9e40-20740d2e9cbd service nova] Acquiring lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b9c8069f-1485-4542-a7b4-f0fc48b7dfdb req-21057969-3227-4d55-9e40-20740d2e9cbd service nova] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b9c8069f-1485-4542-a7b4-f0fc48b7dfdb req-21057969-3227-4d55-9e40-20740d2e9cbd service nova] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-b9c8069f-1485-4542-a7b4-f0fc48b7dfdb req-21057969-3227-4d55-9e40-20740d2e9cbd service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] No waiting events found dispatching network-vif-unplugged-101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-b9c8069f-1485-4542-a7b4-f0fc48b7dfdb req-21057969-3227-4d55-9e40-20740d2e9cbd service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Received event network-vif-unplugged-101928c4-5d7d-49b7-bb17-d730e91d9d50 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:53:44 user nova-compute[74278]: INFO nova.virt.block_device [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Attempting to driver detach volume 7335b8f1-2594-4f56-a717-bc2f9b1c6a4b from mountpoint /dev/vdb
Oct 30 10:53:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Attempting to detach device vdb from instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 10:53:44 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:44 user nova-compute[74278]:   <source dev="/dev/sdi"/>
Oct 30 10:53:44 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:53:44 user nova-compute[74278]:   <serial>7335b8f1-2594-4f56-a717-bc2f9b1c6a4b</serial>
Oct 30 10:53:44 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 10:53:44 user nova-compute[74278]: </disk>
Oct 30 10:53:44 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:53:44 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Successfully detached device vdb from instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 from the persistent domain config.
Oct 30 10:53:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 10:53:44 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:53:44 user nova-compute[74278]:   <source dev="/dev/sdi"/>
Oct 30 10:53:44 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:53:44 user nova-compute[74278]:   <serial>7335b8f1-2594-4f56-a717-bc2f9b1c6a4b</serial>
Oct 30 10:53:44 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 10:53:44 user nova-compute[74278]: </disk>
Oct 30 10:53:44 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "interface-0cecb81b-55ae-46de-8f32-433f2ff42bad-181a6ded-caac-4f51-ac21-3972c8cc8320" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "interface-0cecb81b-55ae-46de-8f32-433f2ff42bad-181a6ded-caac-4f51-ac21-3972c8cc8320" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG nova.objects.instance [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lazy-loading 'flavor' on Instance uuid 0cecb81b-55ae-46de-8f32-433f2ff42bad {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1244481291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1244481291',id=8,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hCZm+p9pneLXjvGF3q+uUILN9j75Q8EhDi66gIZTDo8x7vX6mAeb+cwmbpumy2JKJSnUtNn0gun7/lwnmnulLD1nk9wxII3Jt323IfPYgkyT8hzWa5M48LRz07jpuRw==',key_name='tempest-keypair-586447970',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:51:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='253f67cb486c46d1ad6e5ca4b1287893',ramdisk_id='',reservation_id='r-twe11yrb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-112217138',owner_user_name='tempest-TaggedAttachmentsTest-112217138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b046e419a34ce591eebd5c11332017',uuid=0cecb81b-55ae-46de-8f32-433f2ff42bad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converting VIF {"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:11:51,bridge_name='br-int',has_traffic_filtering=True,id=181a6ded-caac-4f51-ac21-3972c8cc8320,network=Network(8b040c63-4590-4a68-b47e-adf7aaba750f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6ded-ca') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:68:11:51"/><model type="virtio"/><mtu size="1442"/><target dev="tap181a6ded-ca"/></interface> {{(pid=74278) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:68:11:51"/><model type="virtio"/><mtu size="1442"/><target dev="tap181a6ded-ca"/></interface> {{(pid=74278) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Attempting to detach device tap181a6ded-ca from instance 0cecb81b-55ae-46de-8f32-433f2ff42bad from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] detach device xml: <interface type="ethernet">
Oct 30 10:53:45 user nova-compute[74278]:   <mac address="fa:16:3e:68:11:51"/>
Oct 30 10:53:45 user nova-compute[74278]:   <model type="virtio"/>
Oct 30 10:53:45 user nova-compute[74278]:   <mtu size="1442"/>
Oct 30 10:53:45 user nova-compute[74278]:   <target dev="tap181a6ded-ca"/>
Oct 30 10:53:45 user nova-compute[74278]: </interface>
Oct 30 10:53:45 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:68:11:51"/><model type="virtio"/><mtu size="1442"/><target dev="tap181a6ded-ca"/></interface> {{(pid=74278) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:68:11:51"/><model type="virtio"/><mtu size="1442"/><target dev="tap181a6ded-ca"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 30 10:53:45 user nova-compute[74278]:   <name>instance-00000008</name>
Oct 30 10:53:45 user nova-compute[74278]:   <uuid>0cecb81b-55ae-46de-8f32-433f2ff42bad</uuid>
Oct 30 10:53:45 user nova-compute[74278]:   <metadata>
Oct 30 10:53:45 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:53:45 user nova-compute[74278]:   <nova:package version="0.0.0"/>
Oct 30 10:53:45 user nova-compute[74278]:   <nova:name>tempest-device-tagging-server-1244481291</nova:name>
Oct 30 10:53:45 user nova-compute[74278]:   <nova:creationTime>2023-10-30 10:52:50</nova:creationTime>
Oct 30 10:53:45 user nova-compute[74278]:   <nova:flavor name="m1.tiny">
Oct 30 10:53:45 user nova-compute[74278]:     <nova:memory>512</nova:memory>
Oct 30 10:53:45 user nova-compute[74278]:     <nova:disk>1</nova:disk>
Oct 30 10:53:45 user nova-compute[74278]:     <nova:swap>0</nova:swap>
Oct 30 10:53:45 user nova-compute[74278]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:53:45 user nova-compute[74278]:     <nova:vcpus>1</nova:vcpus>
Oct 30 10:53:45 user nova-compute[74278]:   </nova:flavor>
Oct 30 10:53:45 user nova-compute[74278]:   <nova:owner>
Oct 30 10:53:45 user nova-compute[74278]:     <nova:user uuid="c6b046e419a34ce591eebd5c11332017">tempest-TaggedAttachmentsTest-112217138-project-member</nova:user>
Oct 30 10:53:45 user nova-compute[74278]:     <nova:project uuid="253f67cb486c46d1ad6e5ca4b1287893">tempest-TaggedAttachmentsTest-112217138</nova:project>
Oct 30 10:53:45 user nova-compute[74278]:   </nova:owner>
Oct 30 10:53:45 user nova-compute[74278]:   <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:53:45 user nova-compute[74278]:   <nova:ports>
Oct 30 10:53:45 user nova-compute[74278]:     <nova:port uuid="a719761e-73d6-414b-a6d5-68e6b757e402">
Oct 30 10:53:45 user nova-compute[74278]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 10:53:45 user nova-compute[74278]:     </nova:port>
Oct 30 10:53:45 user nova-compute[74278]:     <nova:port uuid="181a6ded-caac-4f51-ac21-3972c8cc8320">
Oct 30 10:53:45 user nova-compute[74278]:       <nova:ip type="fixed" address="10.10.10.200" ipVersion="4"/>
Oct 30 10:53:45 user nova-compute[74278]:     </nova:port>
Oct 30 10:53:45 user nova-compute[74278]:   </nova:ports>
Oct 30 10:53:45 user nova-compute[74278]: </nova:instance>
Oct 30 10:53:45 user nova-compute[74278]:   </metadata>
Oct 30 10:53:45 user nova-compute[74278]:   <memory unit='KiB'>524288</memory>
Oct 30 10:53:45 user nova-compute[74278]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 30 10:53:45 user nova-compute[74278]:   <vcpu placement='static'>1</vcpu>
Oct 30 10:53:45 user nova-compute[74278]:   <resource>
Oct 30 10:53:45 user nova-compute[74278]:     <partition>/machine</partition>
Oct 30 10:53:45 user nova-compute[74278]:   </resource>
Oct 30 10:53:45 user nova-compute[74278]:   <sysinfo type='smbios'>
Oct 30 10:53:45 user nova-compute[74278]:     <system>
Oct 30 10:53:45 user nova-compute[74278]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 30 10:53:45 user nova-compute[74278]:       <entry name='product'>OpenStack Nova</entry>
Oct 30 10:53:45 user nova-compute[74278]:       <entry name='version'>0.0.0</entry>
Oct 30 10:53:45 user nova-compute[74278]:       <entry name='serial'>0cecb81b-55ae-46de-8f32-433f2ff42bad</entry>
Oct 30 10:53:45 user nova-compute[74278]:       <entry name='uuid'>0cecb81b-55ae-46de-8f32-433f2ff42bad</entry>
Oct 30 10:53:45 user nova-compute[74278]:       <entry name='family'>Virtual Machine</entry>
Oct 30 10:53:45 user nova-compute[74278]:     </system>
Oct 30 10:53:45 user nova-compute[74278]:   </sysinfo>
Oct 30 10:53:45 user nova-compute[74278]:   <os>
Oct 30 10:53:45 user nova-compute[74278]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 30 10:53:45 user nova-compute[74278]:     <boot dev='hd'/>
Oct 30 10:53:45 user nova-compute[74278]:     <smbios mode='sysinfo'/>
Oct 30 10:53:45 user nova-compute[74278]:   </os>
Oct 30 10:53:45 user nova-compute[74278]:   <features>
Oct 30 10:53:45 user nova-compute[74278]:     <acpi/>
Oct 30 10:53:45 user nova-compute[74278]:     <apic/>
Oct 30 10:53:45 user nova-compute[74278]:     <vmcoreinfo state='on'/>
Oct 30 10:53:45 user nova-compute[74278]:   </features>
Oct 30 10:53:45 user nova-compute[74278]:   <cpu mode='custom' match='exact' check='full'>
Oct 30 10:53:45 user nova-compute[74278]:     <model fallback='forbid'>Nehalem</model>
Oct 30 10:53:45 user nova-compute[74278]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 30 10:53:45 user nova-compute[74278]:     <feature policy='require' name='vme'/>
Oct 30 10:53:45 user nova-compute[74278]:     <feature policy='require' name='x2apic'/>
Oct 30 10:53:45 user nova-compute[74278]:     <feature policy='require' name='hypervisor'/>
Oct 30 10:53:45 user nova-compute[74278]:   </cpu>
Oct 30 10:53:45 user nova-compute[74278]:   <clock offset='utc'>
Oct 30 10:53:45 user nova-compute[74278]:     <timer name='pit' tickpolicy='delay'/>
Oct 30 10:53:45 user nova-compute[74278]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 30 10:53:45 user nova-compute[74278]:     <timer name='hpet' present='no'/>
Oct 30 10:53:45 user nova-compute[74278]:   </clock>
Oct 30 10:53:45 user nova-compute[74278]:   <on_poweroff>destroy</on_poweroff>
Oct 30 10:53:45 user nova-compute[74278]:   <on_reboot>restart</on_reboot>
Oct 30 10:53:45 user nova-compute[74278]:   <on_crash>destroy</on_crash>
Oct 30 10:53:45 user nova-compute[74278]:   <devices>
Oct 30 10:53:45 user nova-compute[74278]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 10:53:45 user nova-compute[74278]:     <disk type='file' device='disk'>
Oct 30 10:53:45 user nova-compute[74278]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 30 10:53:45 user nova-compute[74278]:       <source file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk' index='2'/>
Oct 30 10:53:45 user nova-compute[74278]:       <backingStore type='file' index='3'>
Oct 30 10:53:45 user nova-compute[74278]:         <format type='raw'/>
Oct 30 10:53:45 user nova-compute[74278]:         <source file='/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0'/>
Oct 30 10:53:45 user nova-compute[74278]:         <backingStore/>
Oct 30 10:53:45 user nova-compute[74278]:       </backingStore>
Oct 30 10:53:45 user nova-compute[74278]:       <target dev='vda' bus='virtio'/>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='virtio-disk0'/>
Oct 30 10:53:45 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 30 10:53:45 user nova-compute[74278]:     </disk>
Oct 30 10:53:45 user nova-compute[74278]:     <disk type='file' device='cdrom'>
Oct 30 10:53:45 user nova-compute[74278]:       <driver name='qemu' type='raw' cache='none'/>
Oct 30 10:53:45 user nova-compute[74278]:       <source file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk.config' index='1'/>
Oct 30 10:53:45 user nova-compute[74278]:       <backingStore/>
Oct 30 10:53:45 user nova-compute[74278]:       <target dev='hda' bus='ide'/>
Oct 30 10:53:45 user nova-compute[74278]:       <readonly/>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='ide0-0-0'/>
Oct 30 10:53:45 user nova-compute[74278]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 30 10:53:45 user nova-compute[74278]:     </disk>
Oct 30 10:53:45 user nova-compute[74278]:     <controller type='usb' index='0' model='none'>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='usb'/>
Oct 30 10:53:45 user nova-compute[74278]:     </controller>
Oct 30 10:53:45 user nova-compute[74278]:     <controller type='pci' index='0' model='pci-root'>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='pci.0'/>
Oct 30 10:53:45 user nova-compute[74278]:     </controller>
Oct 30 10:53:45 user nova-compute[74278]:     <controller type='ide' index='0'>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='ide'/>
Oct 30 10:53:45 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 30 10:53:45 user nova-compute[74278]:     </controller>
Oct 30 10:53:45 user nova-compute[74278]:     <interface type='ethernet'>
Oct 30 10:53:45 user nova-compute[74278]:       <mac address='fa:16:3e:ac:42:07'/>
Oct 30 10:53:45 user nova-compute[74278]:       <target dev='tapa719761e-73'/>
Oct 30 10:53:45 user nova-compute[74278]:       <model type='virtio'/>
Oct 30 10:53:45 user nova-compute[74278]:       <mtu size='1442'/>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='net0'/>
Oct 30 10:53:45 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 30 10:53:45 user nova-compute[74278]:     </interface>
Oct 30 10:53:45 user nova-compute[74278]:     <interface type='ethernet'>
Oct 30 10:53:45 user nova-compute[74278]:       <mac address='fa:16:3e:68:11:51'/>
Oct 30 10:53:45 user nova-compute[74278]:       <target dev='tap181a6ded-ca'/>
Oct 30 10:53:45 user nova-compute[74278]:       <model type='virtio'/>
Oct 30 10:53:45 user nova-compute[74278]:       <mtu size='1442'/>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='net1'/>
Oct 30 10:53:45 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 30 10:53:45 user nova-compute[74278]:     </interface>
Oct 30 10:53:45 user nova-compute[74278]:     <serial type='pty'>
Oct 30 10:53:45 user nova-compute[74278]:       <source path='/dev/pts/7'/>
Oct 30 10:53:45 user nova-compute[74278]:       <log file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/console.log' append='off'/>
Oct 30 10:53:45 user nova-compute[74278]:       <target type='isa-serial' port='0'>
Oct 30 10:53:45 user nova-compute[74278]:         <model name='isa-serial'/>
Oct 30 10:53:45 user nova-compute[74278]:       </target>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='serial0'/>
Oct 30 10:53:45 user nova-compute[74278]:     </serial>
Oct 30 10:53:45 user nova-compute[74278]:     <console type='pty' tty='/dev/pts/7'>
Oct 30 10:53:45 user nova-compute[74278]:       <source path='/dev/pts/7'/>
Oct 30 10:53:45 user nova-compute[74278]:       <log file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/console.log' append='off'/>
Oct 30 10:53:45 user nova-compute[74278]:       <target type='serial' port='0'/>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='serial0'/>
Oct 30 10:53:45 user nova-compute[74278]:     </console>
Oct 30 10:53:45 user nova-compute[74278]:     <input type='mouse' bus='ps2'>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='input0'/>
Oct 30 10:53:45 user nova-compute[74278]:     </input>
Oct 30 10:53:45 user nova-compute[74278]:     <input type='keyboard' bus='ps2'>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='input1'/>
Oct 30 10:53:45 user nova-compute[74278]:     </input>
Oct 30 10:53:45 user nova-compute[74278]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 30 10:53:45 user nova-compute[74278]:       <listen type='address' address='0.0.0.0'/>
Oct 30 10:53:45 user nova-compute[74278]:     </graphics>
Oct 30 10:53:45 user nova-compute[74278]:     <audio id='1' type='none'/>
Oct 30 10:53:45 user nova-compute[74278]:     <video>
Oct 30 10:53:45 user nova-compute[74278]:       <model type='virtio' heads='1' primary='yes'/>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='video0'/>
Oct 30 10:53:45 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 30 10:53:45 user nova-compute[74278]:     </video>
Oct 30 10:53:45 user nova-compute[74278]:     <memballoon model='virtio'>
Oct 30 10:53:45 user nova-compute[74278]:       <stats period='10'/>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='balloon0'/>
Oct 30 10:53:45 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 30 10:53:45 user nova-compute[74278]:     </memballoon>
Oct 30 10:53:45 user nova-compute[74278]:     <rng model='virtio'>
Oct 30 10:53:45 user nova-compute[74278]:       <backend model='random'>/dev/urandom</backend>
Oct 30 10:53:45 user nova-compute[74278]:       <alias name='rng0'/>
Oct 30 10:53:45 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 30 10:53:45 user nova-compute[74278]:     </rng>
Oct 30 10:53:45 user nova-compute[74278]:   </devices>
Oct 30 10:53:45 user nova-compute[74278]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 30 10:53:45 user nova-compute[74278]:     <label>libvirt-0cecb81b-55ae-46de-8f32-433f2ff42bad</label>
Oct 30 10:53:45 user nova-compute[74278]:     <imagelabel>libvirt-0cecb81b-55ae-46de-8f32-433f2ff42bad</imagelabel>
Oct 30 10:53:45 user nova-compute[74278]:   </seclabel>
Oct 30 10:53:45 user nova-compute[74278]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 30 10:53:45 user nova-compute[74278]:     <label>+64055:+108</label>
Oct 30 10:53:45 user nova-compute[74278]:     <imagelabel>+64055:+108</imagelabel>
Oct 30 10:53:45 user nova-compute[74278]:   </seclabel>
Oct 30 10:53:45 user nova-compute[74278]: </domain>
Oct 30 10:53:45 user nova-compute[74278]:  {{(pid=74278) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 30 10:53:45 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Successfully detached device tap181a6ded-ca from instance 0cecb81b-55ae-46de-8f32-433f2ff42bad from the persistent domain config.
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] (1/8): Attempting to detach device tap181a6ded-ca with device alias net1 from instance 0cecb81b-55ae-46de-8f32-433f2ff42bad from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] detach device xml: <interface type="ethernet">
Oct 30 10:53:45 user nova-compute[74278]:   <mac address="fa:16:3e:68:11:51"/>
Oct 30 10:53:45 user nova-compute[74278]:   <model type="virtio"/>
Oct 30 10:53:45 user nova-compute[74278]:   <mtu size="1442"/>
Oct 30 10:53:45 user nova-compute[74278]:   <target dev="tap181a6ded-ca"/>
Oct 30 10:53:45 user nova-compute[74278]: </interface>
Oct 30 10:53:45 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 10:53:45 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Instance destroyed successfully.
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.objects.instance [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lazy-loading 'resources' on Instance uuid 7264e69a-5781-420d-91b4-ab7d494c40ca {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:50:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1912750678',display_name='tempest-AttachSCSIVolumeTestJSON-server-1912750678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1912750678',id=7,image_ref='519e1492-f7ea-41e7-a129-64d3283dfcac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChkCjyeOrnpWhsZL4+DzPIAcOVATXVtDFdHnQa7YLdcZKf7zfclQnS87alIuYvLB5dsa2goL8kZOTDXMbdZTGPNpUncTTtlKtGF7NxVshAzceQCZW3X1qjdTko92H6WEA==',key_name='tempest-keypair-1297892646',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:51:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38de12f052e945949c11b4b0603b0610',ramdisk_id='',reservation_id='r-hpbsldpe',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='519e1492-f7ea-41e7-a129-64d3283dfcac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-70315466',owner_user_name='tempest-AttachSCSIVolumeTestJSON-70315466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:51:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='180e3b3e92c14c05b1cea8c863c91431',uuid=7264e69a-5781-420d-91b4-ab7d494c40ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "address": "fa:16:3e:5b:71:4c", "network": {"id": "26926697-8d50-436c-bf17-1acc7adfb34b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1400788987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38de12f052e945949c11b4b0603b0610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap101928c4-5d", "ovs_interfaceid": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Converting VIF {"id": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "address": "fa:16:3e:5b:71:4c", "network": {"id": "26926697-8d50-436c-bf17-1acc7adfb34b", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1400788987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38de12f052e945949c11b4b0603b0610", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap101928c4-5d", "ovs_interfaceid": "101928c4-5d7d-49b7-bb17-d730e91d9d50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:71:4c,bridge_name='br-int',has_traffic_filtering=True,id=101928c4-5d7d-49b7-bb17-d730e91d9d50,network=Network(26926697-8d50-436c-bf17-1acc7adfb34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap101928c4-5d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG os_vif [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:71:4c,bridge_name='br-int',has_traffic_filtering=True,id=101928c4-5d7d-49b7-bb17-d730e91d9d50,network=Network(26926697-8d50-436c-bf17-1acc7adfb34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap101928c4-5d') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap101928c4-5d, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Start waiting for the detach event from libvirt for device tap181a6ded-ca with device alias net1 for instance 0cecb81b-55ae-46de-8f32-433f2ff42bad {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12b6bf2a-3c5a-45ae-87bb-49b5bb5ea518) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:45 user nova-compute[74278]: INFO os_vif [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:71:4c,bridge_name='br-int',has_traffic_filtering=True,id=101928c4-5d7d-49b7-bb17-d730e91d9d50,network=Network(26926697-8d50-436c-bf17-1acc7adfb34b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap101928c4-5d')
Oct 30 10:53:45 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Deleting instance files /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca_del
Oct 30 10:53:45 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Deletion of /opt/stack/data/nova/instances/7264e69a-5781-420d-91b4-ab7d494c40ca_del complete
Oct 30 10:53:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:45 user nova-compute[74278]: INFO nova.compute.manager [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 30 10:53:45 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.compute.manager [req-5e452b5e-93f7-4f35-9d71-f0fffb9415b9 req-9236ec8e-d77f-4000-8269-f8f0b020193d service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-vif-unplugged-181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5e452b5e-93f7-4f35-9d71-f0fffb9415b9 req-9236ec8e-d77f-4000-8269-f8f0b020193d service nova] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5e452b5e-93f7-4f35-9d71-f0fffb9415b9 req-9236ec8e-d77f-4000-8269-f8f0b020193d service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5e452b5e-93f7-4f35-9d71-f0fffb9415b9 req-9236ec8e-d77f-4000-8269-f8f0b020193d service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:45 user nova-compute[74278]: DEBUG nova.compute.manager [req-5e452b5e-93f7-4f35-9d71-f0fffb9415b9 req-9236ec8e-d77f-4000-8269-f8f0b020193d service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] No waiting events found dispatching network-vif-unplugged-181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:45 user nova-compute[74278]: WARNING nova.compute.manager [req-5e452b5e-93f7-4f35-9d71-f0fffb9415b9 req-9236ec8e-d77f-4000-8269-f8f0b020193d service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received unexpected event network-vif-unplugged-181a6ded-caac-4f51-ac21-3972c8cc8320 for instance with vm_state active and task_state None.
Oct 30 10:53:46 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:53:46 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Took 0.95 seconds to deallocate network for instance.
Oct 30 10:53:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-655c5232-2907-4352-8b07-5b25e104f605 req-eeaca08a-bacd-4402-a249-e3313c904ea2 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Received event network-vif-plugged-101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-655c5232-2907-4352-8b07-5b25e104f605 req-eeaca08a-bacd-4402-a249-e3313c904ea2 service nova] Acquiring lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-655c5232-2907-4352-8b07-5b25e104f605 req-eeaca08a-bacd-4402-a249-e3313c904ea2 service nova] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-655c5232-2907-4352-8b07-5b25e104f605 req-eeaca08a-bacd-4402-a249-e3313c904ea2 service nova] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-655c5232-2907-4352-8b07-5b25e104f605 req-eeaca08a-bacd-4402-a249-e3313c904ea2 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] No waiting events found dispatching network-vif-plugged-101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:46 user nova-compute[74278]: WARNING nova.compute.manager [req-655c5232-2907-4352-8b07-5b25e104f605 req-eeaca08a-bacd-4402-a249-e3313c904ea2 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Received unexpected event network-vif-plugged-101928c4-5d7d-49b7-bb17-d730e91d9d50 for instance with vm_state active and task_state deleting.
Oct 30 10:53:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-655c5232-2907-4352-8b07-5b25e104f605 req-eeaca08a-bacd-4402-a249-e3313c904ea2 service nova] [instance: 7264e69a-5781-420d-91b4-ab7d494c40ca] Received event network-vif-deleted-101928c4-5d7d-49b7-bb17-d730e91d9d50 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:46 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:53:46 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:53:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:47 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Deleted allocations for instance 7264e69a-5781-420d-91b4-ab7d494c40ca
Oct 30 10:53:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-738b95af-692b-4287-906a-70e81aea63fa tempest-AttachSCSIVolumeTestJSON-70315466 tempest-AttachSCSIVolumeTestJSON-70315466-project-member] Lock "7264e69a-5781-420d-91b4-ab7d494c40ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.991s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-df244d1b-d383-4427-9544-f6646d44054c req-3a9f307a-5ad9-4371-a8cf-30dad26de78c service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-vif-plugged-181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:53:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-df244d1b-d383-4427-9544-f6646d44054c req-3a9f307a-5ad9-4371-a8cf-30dad26de78c service nova] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-df244d1b-d383-4427-9544-f6646d44054c req-3a9f307a-5ad9-4371-a8cf-30dad26de78c service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-df244d1b-d383-4427-9544-f6646d44054c req-3a9f307a-5ad9-4371-a8cf-30dad26de78c service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-df244d1b-d383-4427-9544-f6646d44054c req-3a9f307a-5ad9-4371-a8cf-30dad26de78c service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] No waiting events found dispatching network-vif-plugged-181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:53:47 user nova-compute[74278]: WARNING nova.compute.manager [req-df244d1b-d383-4427-9544-f6646d44054c req-3a9f307a-5ad9-4371-a8cf-30dad26de78c service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received unexpected event network-vif-plugged-181a6ded-caac-4f51-ac21-3972c8cc8320 for instance with vm_state active and task_state None.
Oct 30 10:53:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:53:59 user nova-compute[74278]: INFO nova.compute.claims [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Claim successful on node user
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:53:59 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:53:59 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Creating image(s)
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Ensure instance console log exists: /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Start _get_guest_xml network_info=[{"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDvLNukE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2591f731-03b7-49b6-93af-c5b63e505127', 'attached_at': '', 'detached_at': '', 'volume_id': '32778937-dac7-439c-89b4-6275dcdc17a1', 'serial': '32778937-dac7-439c-89b4-6275dcdc17a1'}, 'attachment_id': 'faa30bfb-945e-4a6a-94fa-d89a1a6d3e73', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:53:59 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:53:59 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.policy [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '525f98e0bed241fdad3962fda627b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928164ecd5c44dddb93fbecfeaa44071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDvLNukE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:53:59 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:59 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:53:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:53:59 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:53:59 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Creating image(s)
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "/opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "/opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "/opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:53:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[97960d20-244a-40fc-9413-6efecf1d9fb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:54:00 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[94490473-1f38-4bb6-a82c-7637ec1df755]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1] added
Oct 30 10:54:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b26ba56-8591-4f6b-a981-81426c2d19ec]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[49725245-ba8b-40d0-a78e-353c00b1ae96]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xDvLNukE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xDvLNukE" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf769a2-3585-4b17-a1ae-a65a345f9774]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xDvLNukE'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d71474f7-0b91-49e5-b03b-56628ae7823e is timed out.
Oct 30 10:54:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Successfully detached device vdb from instance d71474f7-0b91-49e5-b03b-56628ae7823e from the live domain config.
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[794dd8cc-58a8-4947-8253-34bcf1e795ef]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zORHYMeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:54:00 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.198s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d20766-6ede-4736-85ce-70679fc047d6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9b5c78-29f1-42ef-b42f-16ee6708e5d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1, portal: 172.16.0.220,3260]
Oct 30 10:54:00 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1, portal: 172.16.0.220,3260] successful.
Oct 30 10:54:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk 1073741824" returned: 0 in 0.067s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3a1cdd-a642-4e68-9cd4-d230ffcb3a1b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[729f7978-91ee-4aa6-8b58-1f3d3d92cd43]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:00 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:54:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.563s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1742d2e-5106-418b-9842-f9d54492ffaa]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDvLNukE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.202s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Cannot resize image /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Ensure instance console log exists: /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:00 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Successfully created port: c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.614s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] <== connect_volume: return (1615ms) {'type': 'block', 'scsi_wwn': '26332613038636338', 'path': '/dev/sdf'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332613038636338', 'path': '/dev/sdf'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.425s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfce55b-5fb0-4508-898e-11afbd617cc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:54:01 user nova-compute[74278]: No targets found.
Oct 30 10:54:01 user nova-compute[74278]: iSNS:
Oct 30 10:54:01 user nova-compute[74278]: No targets found.
Oct 30 10:54:01 user nova-compute[74278]: STATIC:
Oct 30 10:54:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7
Oct 30 10:54:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b
Oct 30 10:54:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db
Oct 30 10:54:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3
Oct 30 10:54:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:54:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6
Oct 30 10:54:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47
Oct 30 10:54:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:01 user nova-compute[74278]: FIRMWARE:
Oct 30 10:54:01 user nova-compute[74278]: No targets found.
Oct 30 10:54:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:54:01 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:54:01 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-716124331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-716124331',id=13,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-guw9p7hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:53:24Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=2591f731-03b7-49b6-93af-c5b63e505127,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:1d:9a,bridge_name='br-int',has_traffic_filtering=True,id=f8d17d66-8240-41ca-855d-531672079adb,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d17d66-82') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.objects.instance [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'pci_devices' on Instance uuid 2591f731-03b7-49b6-93af-c5b63e505127 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a5e49a-4ace-45b8-870b-b4a43bf1b82a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Successfully updated port: c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:54:01 user nova-compute[74278]:   <uuid>2591f731-03b7-49b6-93af-c5b63e505127</uuid>
Oct 30 10:54:01 user nova-compute[74278]:   <name>instance-0000000d</name>
Oct 30 10:54:01 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:54:01 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:54:01 user nova-compute[74278]:   <metadata>
Oct 30 10:54:01 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:54:01 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:54:01 user nova-compute[74278]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-716124331</nova:name>
Oct 30 10:54:01 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:53:59</nova:creationTime>
Oct 30 10:54:01 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:54:01 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:54:01 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:54:01 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:54:01 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:54:01 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:54:01 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:54:01 user nova-compute[74278]:       <nova:owner>
Oct 30 10:54:01 user nova-compute[74278]:         <nova:user uuid="e6e338955c2f4d4fae81e9fbf93eff39">tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member</nova:user>
Oct 30 10:54:01 user nova-compute[74278]:         <nova:project uuid="0f6de366be034e23a4d60302674b76c9">tempest-ServerBootFromVolumeStableRescueTest-1058902108</nova:project>
Oct 30 10:54:01 user nova-compute[74278]:       </nova:owner>
Oct 30 10:54:01 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:54:01 user nova-compute[74278]:       <nova:ports>
Oct 30 10:54:01 user nova-compute[74278]:         <nova:port uuid="f8d17d66-8240-41ca-855d-531672079adb">
Oct 30 10:54:01 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 10:54:01 user nova-compute[74278]:         </nova:port>
Oct 30 10:54:01 user nova-compute[74278]:       </nova:ports>
Oct 30 10:54:01 user nova-compute[74278]:     </nova:instance>
Oct 30 10:54:01 user nova-compute[74278]:   </metadata>
Oct 30 10:54:01 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:54:01 user nova-compute[74278]:     <system>
Oct 30 10:54:01 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:54:01 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:54:01 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:54:01 user nova-compute[74278]:       <entry name="serial">2591f731-03b7-49b6-93af-c5b63e505127</entry>
Oct 30 10:54:01 user nova-compute[74278]:       <entry name="uuid">2591f731-03b7-49b6-93af-c5b63e505127</entry>
Oct 30 10:54:01 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:54:01 user nova-compute[74278]:     </system>
Oct 30 10:54:01 user nova-compute[74278]:   </sysinfo>
Oct 30 10:54:01 user nova-compute[74278]:   <os>
Oct 30 10:54:01 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:54:01 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:54:01 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:54:01 user nova-compute[74278]:   </os>
Oct 30 10:54:01 user nova-compute[74278]:   <features>
Oct 30 10:54:01 user nova-compute[74278]:     <acpi/>
Oct 30 10:54:01 user nova-compute[74278]:     <apic/>
Oct 30 10:54:01 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:54:01 user nova-compute[74278]:   </features>
Oct 30 10:54:01 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:54:01 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:54:01 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:54:01 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:54:01 user nova-compute[74278]:   </clock>
Oct 30 10:54:01 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:54:01 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:54:01 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:54:01 user nova-compute[74278]:   </cpu>
Oct 30 10:54:01 user nova-compute[74278]:   <devices>
Oct 30 10:54:01 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 10:54:01 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:54:01 user nova-compute[74278]:       <source dev="/dev/sdf"/>
Oct 30 10:54:01 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:54:01 user nova-compute[74278]:       <serial>32778937-dac7-439c-89b4-6275dcdc17a1</serial>
Oct 30 10:54:01 user nova-compute[74278]:     </disk>
Oct 30 10:54:01 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:54:01 user nova-compute[74278]:       <mac address="fa:16:3e:87:1d:9a"/>
Oct 30 10:54:01 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:54:01 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:54:01 user nova-compute[74278]:       <target dev="tapf8d17d66-82"/>
Oct 30 10:54:01 user nova-compute[74278]:     </interface>
Oct 30 10:54:01 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:54:01 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/console.log" append="off"/>
Oct 30 10:54:01 user nova-compute[74278]:     </serial>
Oct 30 10:54:01 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:54:01 user nova-compute[74278]:     <video>
Oct 30 10:54:01 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:54:01 user nova-compute[74278]:     </video>
Oct 30 10:54:01 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:54:01 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:54:01 user nova-compute[74278]:     </rng>
Oct 30 10:54:01 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:54:01 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:54:01 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:54:01 user nova-compute[74278]:     </memballoon>
Oct 30 10:54:01 user nova-compute[74278]:   </devices>
Oct 30 10:54:01 user nova-compute[74278]: </domain>
Oct 30 10:54:01 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-716124331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-716124331',id=13,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-guw9p7hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:53:24Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=2591f731-03b7-49b6-93af-c5b63e505127,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:1d:9a,bridge_name='br-int',has_traffic_filtering=True,id=f8d17d66-8240-41ca-855d-531672079adb,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d17d66-82') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_vif [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:1d:9a,bridge_name='br-int',has_traffic_filtering=True,id=f8d17d66-8240-41ca-855d-531672079adb,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d17d66-82') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquired lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44325389-9293-53f4-832f-3a9882c0ce21', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ea7e7e-d843-4406-9246-ef5843255ca0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:54:01 user nova-compute[74278]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:01 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:01 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:01 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:01 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:01 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:54:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:54:01 user nova-compute[74278]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:01 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:01 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:01 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:01 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:01 user nova-compute[74278]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 (non-flash)
Oct 30 10:54:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac3928c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7'): ({'sdh'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Removing single pathed devices sdh {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-abcbeac5-cb18-441b-80a8-fad290bb3b32 req-9596bb2a-8465-4e20-8c41-2e6544cf88a3 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-changed-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-abcbeac5-cb18-441b-80a8-fad290bb3b32 req-9596bb2a-8465-4e20-8c41-2e6544cf88a3 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Refreshing instance network info cache due to event network-changed-c2c68f43-b884-4bf0-8948-447c35ce1402. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-abcbeac5-cb18-441b-80a8-fad290bb3b32 req-9596bb2a-8465-4e20-8c41-2e6544cf88a3 service nova] Acquiring lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[50082442-619f-465a-aa52-6660c8819217]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8d17d66-82, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8d17d66-82, col_values=(('qos', UUID('70d4c731-cd2a-43a8-9b53-9780c5fb5e10')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8d17d66-82, col_values=(('external_ids', {'iface-id': 'f8d17d66-8240-41ca-855d-531672079adb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:1d:9a', 'vm-uuid': '2591f731-03b7-49b6-93af-c5b63e505127'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[950ff103-41ee-4d91-976f-8c2e5860d0d8]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Flushing IO for device /dev/sdh {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:54:01 user nova-compute[74278]: INFO os_vif [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:1d:9a,bridge_name='br-int',has_traffic_filtering=True,id=f8d17d66-8240-41ca-855d-531672079adb,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d17d66-82')
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8af7434-4459-4f43-aa09-ca75c97593f2]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.048s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92c0d0b-afa4-41da-b555-a8a6af08a790]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] SCSI volumes sdh have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No VIF found with MAC fa:16:3e:87:1d:9a, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db81ec2-0b88-482f-869b-13d07057d687]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe5650d-3e6f-46db-b494-451363bcaeba]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7, portal: 172.16.0.220,3260]
Oct 30 10:54:01 user nova-compute[74278]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7, portal: 172.16.0.220,3260] successful.
Oct 30 10:54:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68b5dc17-836e-42da-a452-fe506684eda7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8491449a-a40d-43e0-8edf-3aed28418f3f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] <== disconnect_volume: return (1860ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Updating instance_info_cache with network_info: [{"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Releasing lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance network_info: |[{"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-abcbeac5-cb18-441b-80a8-fad290bb3b32 req-9596bb2a-8465-4e20-8c41-2e6544cf88a3 service nova] Acquired lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.network.neutron [req-abcbeac5-cb18-441b-80a8-fad290bb3b32 req-9596bb2a-8465-4e20-8c41-2e6544cf88a3 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Refreshing network info cache for port c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Start _get_guest_xml network_info=[{"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:54:02 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:54:02 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1903672377',display_name='tempest-AttachVolumeTestJSON-server-1903672377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1903672377',id=14,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw2A/RWC5+R4btriIoM9znu/g01+rQRK1t+3KnEGqXbGVndP3w3zXUjxA1EkRr8FgR+n/Ic2QTQuO6qPRQc5lNQ8uEvxmMbEmYIWKtUXYn+0cTj5aRqBB0fgw9nPXA5Dg==',key_name='tempest-keypair-1025364301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='928164ecd5c44dddb93fbecfeaa44071',ramdisk_id='',reservation_id='r-o9r3qvit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2116287848',owner_user_name='tempest-AttachVolumeTestJSON-2116287848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:54:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='525f98e0bed241fdad3962fda627b143',uuid=00dd2fe2-a888-44a1-9dfd-ad72acd03cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converting VIF {"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.objects.instance [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'pci_devices' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:54:02 user nova-compute[74278]:   <uuid>00dd2fe2-a888-44a1-9dfd-ad72acd03cfa</uuid>
Oct 30 10:54:02 user nova-compute[74278]:   <name>instance-0000000e</name>
Oct 30 10:54:02 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:54:02 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:54:02 user nova-compute[74278]:   <metadata>
Oct 30 10:54:02 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:54:02 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:54:02 user nova-compute[74278]:       <nova:name>tempest-AttachVolumeTestJSON-server-1903672377</nova:name>
Oct 30 10:54:02 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:54:02</nova:creationTime>
Oct 30 10:54:02 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:54:02 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:54:02 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:54:02 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:54:02 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:54:02 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:54:02 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:54:02 user nova-compute[74278]:       <nova:owner>
Oct 30 10:54:02 user nova-compute[74278]:         <nova:user uuid="525f98e0bed241fdad3962fda627b143">tempest-AttachVolumeTestJSON-2116287848-project-member</nova:user>
Oct 30 10:54:02 user nova-compute[74278]:         <nova:project uuid="928164ecd5c44dddb93fbecfeaa44071">tempest-AttachVolumeTestJSON-2116287848</nova:project>
Oct 30 10:54:02 user nova-compute[74278]:       </nova:owner>
Oct 30 10:54:02 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:54:02 user nova-compute[74278]:       <nova:ports>
Oct 30 10:54:02 user nova-compute[74278]:         <nova:port uuid="c2c68f43-b884-4bf0-8948-447c35ce1402">
Oct 30 10:54:02 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 10:54:02 user nova-compute[74278]:         </nova:port>
Oct 30 10:54:02 user nova-compute[74278]:       </nova:ports>
Oct 30 10:54:02 user nova-compute[74278]:     </nova:instance>
Oct 30 10:54:02 user nova-compute[74278]:   </metadata>
Oct 30 10:54:02 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:54:02 user nova-compute[74278]:     <system>
Oct 30 10:54:02 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:54:02 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:54:02 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:54:02 user nova-compute[74278]:       <entry name="serial">00dd2fe2-a888-44a1-9dfd-ad72acd03cfa</entry>
Oct 30 10:54:02 user nova-compute[74278]:       <entry name="uuid">00dd2fe2-a888-44a1-9dfd-ad72acd03cfa</entry>
Oct 30 10:54:02 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:54:02 user nova-compute[74278]:     </system>
Oct 30 10:54:02 user nova-compute[74278]:   </sysinfo>
Oct 30 10:54:02 user nova-compute[74278]:   <os>
Oct 30 10:54:02 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:54:02 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:54:02 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:54:02 user nova-compute[74278]:   </os>
Oct 30 10:54:02 user nova-compute[74278]:   <features>
Oct 30 10:54:02 user nova-compute[74278]:     <acpi/>
Oct 30 10:54:02 user nova-compute[74278]:     <apic/>
Oct 30 10:54:02 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:54:02 user nova-compute[74278]:   </features>
Oct 30 10:54:02 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:54:02 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:54:02 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:54:02 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:54:02 user nova-compute[74278]:   </clock>
Oct 30 10:54:02 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:54:02 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:54:02 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:54:02 user nova-compute[74278]:   </cpu>
Oct 30 10:54:02 user nova-compute[74278]:   <devices>
Oct 30 10:54:02 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:54:02 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:54:02 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk"/>
Oct 30 10:54:02 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:54:02 user nova-compute[74278]:     </disk>
Oct 30 10:54:02 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:54:02 user nova-compute[74278]:       <mac address="fa:16:3e:86:86:a1"/>
Oct 30 10:54:02 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:54:02 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:54:02 user nova-compute[74278]:       <target dev="tapc2c68f43-b8"/>
Oct 30 10:54:02 user nova-compute[74278]:     </interface>
Oct 30 10:54:02 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:54:02 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/console.log" append="off"/>
Oct 30 10:54:02 user nova-compute[74278]:     </serial>
Oct 30 10:54:02 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:54:02 user nova-compute[74278]:     <video>
Oct 30 10:54:02 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:54:02 user nova-compute[74278]:     </video>
Oct 30 10:54:02 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:54:02 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:54:02 user nova-compute[74278]:     </rng>
Oct 30 10:54:02 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:54:02 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:54:02 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:54:02 user nova-compute[74278]:     </memballoon>
Oct 30 10:54:02 user nova-compute[74278]:   </devices>
Oct 30 10:54:02 user nova-compute[74278]: </domain>
Oct 30 10:54:02 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1903672377',display_name='tempest-AttachVolumeTestJSON-server-1903672377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1903672377',id=14,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw2A/RWC5+R4btriIoM9znu/g01+rQRK1t+3KnEGqXbGVndP3w3zXUjxA1EkRr8FgR+n/Ic2QTQuO6qPRQc5lNQ8uEvxmMbEmYIWKtUXYn+0cTj5aRqBB0fgw9nPXA5Dg==',key_name='tempest-keypair-1025364301',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='928164ecd5c44dddb93fbecfeaa44071',ramdisk_id='',reservation_id='r-o9r3qvit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2116287848',owner_user_name='tempest-AttachVolumeTestJSON-2116287848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:54:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='525f98e0bed241fdad3962fda627b143',uuid=00dd2fe2-a888-44a1-9dfd-ad72acd03cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converting VIF {"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG os_vif [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8469df57-5f47-51a9-bc7d-b385d03a17bf', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2c68f43-b8, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2c68f43-b8, col_values=(('qos', UUID('c39727b4-8a78-4131-aade-7f829edf9e70')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2c68f43-b8, col_values=(('external_ids', {'iface-id': 'c2c68f43-b884-4bf0-8948-447c35ce1402', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:86:a1', 'vm-uuid': '00dd2fe2-a888-44a1-9dfd-ad72acd03cfa'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:02 user nova-compute[74278]: INFO os_vif [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8')
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No VIF found with MAC fa:16:3e:86:86:a1, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.network.neutron [req-abcbeac5-cb18-441b-80a8-fad290bb3b32 req-9596bb2a-8465-4e20-8c41-2e6544cf88a3 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Updated VIF entry in instance network info cache for port c2c68f43-b884-4bf0-8948-447c35ce1402. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG nova.network.neutron [req-abcbeac5-cb18-441b-80a8-fad290bb3b32 req-9596bb2a-8465-4e20-8c41-2e6544cf88a3 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Updating instance_info_cache with network_info: [{"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-abcbeac5-cb18-441b-80a8-fad290bb3b32 req-9596bb2a-8465-4e20-8c41-2e6544cf88a3 service nova] Releasing lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:54:03 user nova-compute[74278]: DEBUG nova.objects.instance [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lazy-loading 'flavor' on Instance uuid d71474f7-0b91-49e5-b03b-56628ae7823e {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c4e48c64-c5f2-4f11-ae2c-149de375fe80 tempest-VolumesAssistedSnapshotsTest-252182470 tempest-VolumesAssistedSnapshotsTest-252182470-project-admin] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.882s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:04 user nova-compute[74278]: INFO nova.compute.manager [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Terminating instance
Oct 30 10:54:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-e1571bfb-0324-43dc-9e51-b5576c136fc9 req-12819573-9485-4603-9b01-7c5bd9b9aa30 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e1571bfb-0324-43dc-9e51-b5576c136fc9 req-12819573-9485-4603-9b01-7c5bd9b9aa30 service nova] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e1571bfb-0324-43dc-9e51-b5576c136fc9 req-12819573-9485-4603-9b01-7c5bd9b9aa30 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e1571bfb-0324-43dc-9e51-b5576c136fc9 req-12819573-9485-4603-9b01-7c5bd9b9aa30 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-e1571bfb-0324-43dc-9e51-b5576c136fc9 req-12819573-9485-4603-9b01-7c5bd9b9aa30 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] No waiting events found dispatching network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:04 user nova-compute[74278]: WARNING nova.compute.manager [req-e1571bfb-0324-43dc-9e51-b5576c136fc9 req-12819573-9485-4603-9b01-7c5bd9b9aa30 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received unexpected event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb for instance with vm_state building and task_state spawning.
Oct 30 10:54:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 is timed out.
Oct 30 10:54:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Successfully detached device vdb from instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 from the live domain config.
Oct 30 10:54:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzOhTEZq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:54:05 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7a55fc-894a-43b8-ac9f-01aca53dc65e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:54:05 user nova-compute[74278]: No targets found.
Oct 30 10:54:05 user nova-compute[74278]: iSNS:
Oct 30 10:54:05 user nova-compute[74278]: No targets found.
Oct 30 10:54:05 user nova-compute[74278]: STATIC:
Oct 30 10:54:05 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b
Oct 30 10:54:05 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:05 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:05 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db
Oct 30 10:54:05 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:05 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:05 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3
Oct 30 10:54:05 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:05 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:05 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:54:05 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:05 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:05 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6
Oct 30 10:54:05 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:05 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:05 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47
Oct 30 10:54:05 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:05 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:05 user nova-compute[74278]: FIRMWARE:
Oct 30 10:54:05 user nova-compute[74278]: No targets found.
Oct 30 10:54:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:54:05 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:54:05 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cba1f5f-94f6-4400-b4e7-ffa75818695d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:05 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Waiting for libvirt event about the detach of device tap181a6ded-ca with device alias net1 from instance 0cecb81b-55ae-46de-8f32-433f2ff42bad is timed out.
Oct 30 10:54:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:68:11:51"/><model type="virtio"/><mtu size="1442"/><target dev="tap181a6ded-ca"/></interface> {{(pid=74278) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:68:11:51"/><model type="virtio"/><mtu size="1442"/><target dev="tap181a6ded-ca"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 30 10:54:05 user nova-compute[74278]:   <name>instance-00000008</name>
Oct 30 10:54:05 user nova-compute[74278]:   <uuid>0cecb81b-55ae-46de-8f32-433f2ff42bad</uuid>
Oct 30 10:54:05 user nova-compute[74278]:   <metadata>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:54:05 user nova-compute[74278]:   <nova:package version="0.0.0"/>
Oct 30 10:54:05 user nova-compute[74278]:   <nova:name>tempest-device-tagging-server-1244481291</nova:name>
Oct 30 10:54:05 user nova-compute[74278]:   <nova:creationTime>2023-10-30 10:52:50</nova:creationTime>
Oct 30 10:54:05 user nova-compute[74278]:   <nova:flavor name="m1.tiny">
Oct 30 10:54:05 user nova-compute[74278]:     <nova:memory>512</nova:memory>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:disk>1</nova:disk>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:swap>0</nova:swap>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:vcpus>1</nova:vcpus>
Oct 30 10:54:05 user nova-compute[74278]:   </nova:flavor>
Oct 30 10:54:05 user nova-compute[74278]:   <nova:owner>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:user uuid="c6b046e419a34ce591eebd5c11332017">tempest-TaggedAttachmentsTest-112217138-project-member</nova:user>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:project uuid="253f67cb486c46d1ad6e5ca4b1287893">tempest-TaggedAttachmentsTest-112217138</nova:project>
Oct 30 10:54:05 user nova-compute[74278]:   </nova:owner>
Oct 30 10:54:05 user nova-compute[74278]:   <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:54:05 user nova-compute[74278]:   <nova:ports>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:port uuid="a719761e-73d6-414b-a6d5-68e6b757e402">
Oct 30 10:54:05 user nova-compute[74278]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 10:54:05 user nova-compute[74278]:     </nova:port>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:port uuid="181a6ded-caac-4f51-ac21-3972c8cc8320">
Oct 30 10:54:05 user nova-compute[74278]:       <nova:ip type="fixed" address="10.10.10.200" ipVersion="4"/>
Oct 30 10:54:05 user nova-compute[74278]:     </nova:port>
Oct 30 10:54:05 user nova-compute[74278]:   </nova:ports>
Oct 30 10:54:05 user nova-compute[74278]: </nova:instance>
Oct 30 10:54:05 user nova-compute[74278]:   </metadata>
Oct 30 10:54:05 user nova-compute[74278]:   <memory unit='KiB'>524288</memory>
Oct 30 10:54:05 user nova-compute[74278]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 30 10:54:05 user nova-compute[74278]:   <vcpu placement='static'>1</vcpu>
Oct 30 10:54:05 user nova-compute[74278]:   <resource>
Oct 30 10:54:05 user nova-compute[74278]:     <partition>/machine</partition>
Oct 30 10:54:05 user nova-compute[74278]:   </resource>
Oct 30 10:54:05 user nova-compute[74278]:   <sysinfo type='smbios'>
Oct 30 10:54:05 user nova-compute[74278]:     <system>
Oct 30 10:54:05 user nova-compute[74278]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 30 10:54:05 user nova-compute[74278]:       <entry name='product'>OpenStack Nova</entry>
Oct 30 10:54:05 user nova-compute[74278]:       <entry name='version'>0.0.0</entry>
Oct 30 10:54:05 user nova-compute[74278]:       <entry name='serial'>0cecb81b-55ae-46de-8f32-433f2ff42bad</entry>
Oct 30 10:54:05 user nova-compute[74278]:       <entry name='uuid'>0cecb81b-55ae-46de-8f32-433f2ff42bad</entry>
Oct 30 10:54:05 user nova-compute[74278]:       <entry name='family'>Virtual Machine</entry>
Oct 30 10:54:05 user nova-compute[74278]:     </system>
Oct 30 10:54:05 user nova-compute[74278]:   </sysinfo>
Oct 30 10:54:05 user nova-compute[74278]:   <os>
Oct 30 10:54:05 user nova-compute[74278]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 30 10:54:05 user nova-compute[74278]:     <boot dev='hd'/>
Oct 30 10:54:05 user nova-compute[74278]:     <smbios mode='sysinfo'/>
Oct 30 10:54:05 user nova-compute[74278]:   </os>
Oct 30 10:54:05 user nova-compute[74278]:   <features>
Oct 30 10:54:05 user nova-compute[74278]:     <acpi/>
Oct 30 10:54:05 user nova-compute[74278]:     <apic/>
Oct 30 10:54:05 user nova-compute[74278]:     <vmcoreinfo state='on'/>
Oct 30 10:54:05 user nova-compute[74278]:   </features>
Oct 30 10:54:05 user nova-compute[74278]:   <cpu mode='custom' match='exact' check='full'>
Oct 30 10:54:05 user nova-compute[74278]:     <model fallback='forbid'>Nehalem</model>
Oct 30 10:54:05 user nova-compute[74278]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 30 10:54:05 user nova-compute[74278]:     <feature policy='require' name='vme'/>
Oct 30 10:54:05 user nova-compute[74278]:     <feature policy='require' name='x2apic'/>
Oct 30 10:54:05 user nova-compute[74278]:     <feature policy='require' name='hypervisor'/>
Oct 30 10:54:05 user nova-compute[74278]:   </cpu>
Oct 30 10:54:05 user nova-compute[74278]:   <clock offset='utc'>
Oct 30 10:54:05 user nova-compute[74278]:     <timer name='pit' tickpolicy='delay'/>
Oct 30 10:54:05 user nova-compute[74278]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 30 10:54:05 user nova-compute[74278]:     <timer name='hpet' present='no'/>
Oct 30 10:54:05 user nova-compute[74278]:   </clock>
Oct 30 10:54:05 user nova-compute[74278]:   <on_poweroff>destroy</on_poweroff>
Oct 30 10:54:05 user nova-compute[74278]:   <on_reboot>restart</on_reboot>
Oct 30 10:54:05 user nova-compute[74278]:   <on_crash>destroy</on_crash>
Oct 30 10:54:05 user nova-compute[74278]:   <devices>
Oct 30 10:54:05 user nova-compute[74278]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 10:54:05 user nova-compute[74278]:     <disk type='file' device='disk'>
Oct 30 10:54:05 user nova-compute[74278]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 30 10:54:05 user nova-compute[74278]:       <source file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk' index='2'/>
Oct 30 10:54:05 user nova-compute[74278]:       <backingStore type='file' index='3'>
Oct 30 10:54:05 user nova-compute[74278]:         <format type='raw'/>
Oct 30 10:54:05 user nova-compute[74278]:         <source file='/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0'/>
Oct 30 10:54:05 user nova-compute[74278]:         <backingStore/>
Oct 30 10:54:05 user nova-compute[74278]:       </backingStore>
Oct 30 10:54:05 user nova-compute[74278]:       <target dev='vda' bus='virtio'/>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='virtio-disk0'/>
Oct 30 10:54:05 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 30 10:54:05 user nova-compute[74278]:     </disk>
Oct 30 10:54:05 user nova-compute[74278]:     <disk type='file' device='cdrom'>
Oct 30 10:54:05 user nova-compute[74278]:       <driver name='qemu' type='raw' cache='none'/>
Oct 30 10:54:05 user nova-compute[74278]:       <source file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk.config' index='1'/>
Oct 30 10:54:05 user nova-compute[74278]:       <backingStore/>
Oct 30 10:54:05 user nova-compute[74278]:       <target dev='hda' bus='ide'/>
Oct 30 10:54:05 user nova-compute[74278]:       <readonly/>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='ide0-0-0'/>
Oct 30 10:54:05 user nova-compute[74278]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 30 10:54:05 user nova-compute[74278]:     </disk>
Oct 30 10:54:05 user nova-compute[74278]:     <controller type='usb' index='0' model='none'>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='usb'/>
Oct 30 10:54:05 user nova-compute[74278]:     </controller>
Oct 30 10:54:05 user nova-compute[74278]:     <controller type='pci' index='0' model='pci-root'>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='pci.0'/>
Oct 30 10:54:05 user nova-compute[74278]:     </controller>
Oct 30 10:54:05 user nova-compute[74278]:     <controller type='ide' index='0'>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='ide'/>
Oct 30 10:54:05 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 30 10:54:05 user nova-compute[74278]:     </controller>
Oct 30 10:54:05 user nova-compute[74278]:     <interface type='ethernet'>
Oct 30 10:54:05 user nova-compute[74278]:       <mac address='fa:16:3e:ac:42:07'/>
Oct 30 10:54:05 user nova-compute[74278]:       <target dev='tapa719761e-73'/>
Oct 30 10:54:05 user nova-compute[74278]:       <model type='virtio'/>
Oct 30 10:54:05 user nova-compute[74278]:       <mtu size='1442'/>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='net0'/>
Oct 30 10:54:05 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 30 10:54:05 user nova-compute[74278]:     </interface>
Oct 30 10:54:05 user nova-compute[74278]:     <serial type='pty'>
Oct 30 10:54:05 user nova-compute[74278]:       <source path='/dev/pts/7'/>
Oct 30 10:54:05 user nova-compute[74278]:       <log file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/console.log' append='off'/>
Oct 30 10:54:05 user nova-compute[74278]:       <target type='isa-serial' port='0'>
Oct 30 10:54:05 user nova-compute[74278]:         <model name='isa-serial'/>
Oct 30 10:54:05 user nova-compute[74278]:       </target>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='serial0'/>
Oct 30 10:54:05 user nova-compute[74278]:     </serial>
Oct 30 10:54:05 user nova-compute[74278]:     <console type='pty' tty='/dev/pts/7'>
Oct 30 10:54:05 user nova-compute[74278]:       <source path='/dev/pts/7'/>
Oct 30 10:54:05 user nova-compute[74278]:       <log file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/console.log' append='off'/>
Oct 30 10:54:05 user nova-compute[74278]:       <target type='serial' port='0'/>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='serial0'/>
Oct 30 10:54:05 user nova-compute[74278]:     </console>
Oct 30 10:54:05 user nova-compute[74278]:     <input type='mouse' bus='ps2'>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='input0'/>
Oct 30 10:54:05 user nova-compute[74278]:     </input>
Oct 30 10:54:05 user nova-compute[74278]:     <input type='keyboard' bus='ps2'>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='input1'/>
Oct 30 10:54:05 user nova-compute[74278]:     </input>
Oct 30 10:54:05 user nova-compute[74278]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 30 10:54:05 user nova-compute[74278]:       <listen type='address' address='0.0.0.0'/>
Oct 30 10:54:05 user nova-compute[74278]:     </graphics>
Oct 30 10:54:05 user nova-compute[74278]:     <audio id='1' type='none'/>
Oct 30 10:54:05 user nova-compute[74278]:     <video>
Oct 30 10:54:05 user nova-compute[74278]:       <model type='virtio' heads='1' primary='yes'/>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='video0'/>
Oct 30 10:54:05 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 30 10:54:05 user nova-compute[74278]:     </video>
Oct 30 10:54:05 user nova-compute[74278]:     <memballoon model='virtio'>
Oct 30 10:54:05 user nova-compute[74278]:       <stats period='10'/>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='balloon0'/>
Oct 30 10:54:05 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 30 10:54:05 user nova-compute[74278]:     </memballoon>
Oct 30 10:54:05 user nova-compute[74278]:     <rng model='virtio'>
Oct 30 10:54:05 user nova-compute[74278]:       <backend model='random'>/dev/urandom</backend>
Oct 30 10:54:05 user nova-compute[74278]:       <alias name='rng0'/>
Oct 30 10:54:05 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 30 10:54:05 user nova-compute[74278]:     </rng>
Oct 30 10:54:05 user nova-compute[74278]:   </devices>
Oct 30 10:54:05 user nova-compute[74278]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 30 10:54:05 user nova-compute[74278]:     <label>libvirt-0cecb81b-55ae-46de-8f32-433f2ff42bad</label>
Oct 30 10:54:05 user nova-compute[74278]:     <imagelabel>libvirt-0cecb81b-55ae-46de-8f32-433f2ff42bad</imagelabel>
Oct 30 10:54:05 user nova-compute[74278]:   </seclabel>
Oct 30 10:54:05 user nova-compute[74278]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 30 10:54:05 user nova-compute[74278]:     <label>+64055:+108</label>
Oct 30 10:54:05 user nova-compute[74278]:     <imagelabel>+64055:+108</imagelabel>
Oct 30 10:54:05 user nova-compute[74278]:   </seclabel>
Oct 30 10:54:05 user nova-compute[74278]: </domain>
Oct 30 10:54:05 user nova-compute[74278]:  {{(pid=74278) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 30 10:54:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Successfully detached device tap181a6ded-ca from instance 0cecb81b-55ae-46de-8f32-433f2ff42bad from the live domain config.
Oct 30 10:54:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1244481291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1244481291',id=8,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hCZm+p9pneLXjvGF3q+uUILN9j75Q8EhDi66gIZTDo8x7vX6mAeb+cwmbpumy2JKJSnUtNn0gun7/lwnmnulLD1nk9wxII3Jt323IfPYgkyT8hzWa5M48LRz07jpuRw==',key_name='tempest-keypair-586447970',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:51:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='253f67cb486c46d1ad6e5ca4b1287893',ramdisk_id='',reservation_id='r-twe11yrb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-112217138',owner_user_name='tempest-TaggedAttachmentsTest-112217138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b046e419a34ce591eebd5c11332017',uuid=0cecb81b-55ae-46de-8f32-433f2ff42bad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converting VIF {"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:11:51,bridge_name='br-int',has_traffic_filtering=True,id=181a6ded-caac-4f51-ac21-3972c8cc8320,network=Network(8b040c63-4590-4a68-b47e-adf7aaba750f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6ded-ca') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_vif [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:11:51,bridge_name='br-int',has_traffic_filtering=True,id=181a6ded-caac-4f51-ac21-3972c8cc8320,network=Network(8b040c63-4590-4a68-b47e-adf7aaba750f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6ded-ca') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap181a6ded-ca, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52f3d59-d125-4786-8e35-f1364169dd5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:54:05 user nova-compute[74278]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:05 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:05 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:05 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:05 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b (non-flash)
Oct 30 10:54:05 user nova-compute[74278]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:05 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:05 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:05 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:05 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c4f7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b'): ({'sdi'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Removing single pathed devices sdi {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[049566d6-8146-4260-9b07-c39ea64702ad]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=981dcdbe-a61d-4661-83ff-5a7a6da34313) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: INFO os_vif [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:11:51,bridge_name='br-int',has_traffic_filtering=True,id=181a6ded-caac-4f51-ac21-3972c8cc8320,network=Network(8b040c63-4590-4a68-b47e-adf7aaba750f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6ded-ca')
Oct 30 10:54:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:54:05 user nova-compute[74278]:   <nova:package version="0.0.0"/>
Oct 30 10:54:05 user nova-compute[74278]:   <nova:name>tempest-device-tagging-server-1244481291</nova:name>
Oct 30 10:54:05 user nova-compute[74278]:   <nova:creationTime>2023-10-30 10:54:05</nova:creationTime>
Oct 30 10:54:05 user nova-compute[74278]:   <nova:flavor name="m1.tiny">
Oct 30 10:54:05 user nova-compute[74278]:     <nova:memory>512</nova:memory>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:disk>1</nova:disk>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:swap>0</nova:swap>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:vcpus>1</nova:vcpus>
Oct 30 10:54:05 user nova-compute[74278]:   </nova:flavor>
Oct 30 10:54:05 user nova-compute[74278]:   <nova:owner>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:user uuid="c6b046e419a34ce591eebd5c11332017">tempest-TaggedAttachmentsTest-112217138-project-member</nova:user>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:project uuid="253f67cb486c46d1ad6e5ca4b1287893">tempest-TaggedAttachmentsTest-112217138</nova:project>
Oct 30 10:54:05 user nova-compute[74278]:   </nova:owner>
Oct 30 10:54:05 user nova-compute[74278]:   <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:54:05 user nova-compute[74278]:   <nova:ports>
Oct 30 10:54:05 user nova-compute[74278]:     <nova:port uuid="a719761e-73d6-414b-a6d5-68e6b757e402">
Oct 30 10:54:05 user nova-compute[74278]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 10:54:05 user nova-compute[74278]:     </nova:port>
Oct 30 10:54:05 user nova-compute[74278]:   </nova:ports>
Oct 30 10:54:05 user nova-compute[74278]: </nova:instance>
Oct 30 10:54:05 user nova-compute[74278]:  {{(pid=74278) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.043s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f238da-6b67-4dc9-9707-d2de90660df7]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Flushing IO for device /dev/sdi {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bcf056-93d9-43d3-9f10-a8006975fdf9]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.059s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4851876e-a8a2-4c24-a0bf-1186a9dd9ba4]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] SCSI volumes sdi have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[755ee7a6-33be-41d1-904f-4ce5583002d8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4aaaf9-5cec-4b51-b732-c2c0300b9c29]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b, portal: 172.16.0.220,3260]
Oct 30 10:54:05 user nova-compute[74278]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b, portal: 172.16.0.220,3260] successful.
Oct 30 10:54:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7335b8f1-2594-4f56-a717-bc2f9b1c6a4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f4c6fe-a76d-4783-a8be-b5778cbf6434]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] <== disconnect_volume: return (412ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Instance destroyed successfully.
Oct 30 10:54:05 user nova-compute[74278]: DEBUG nova.objects.instance [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lazy-loading 'resources' on Instance uuid 3d06fffa-bbb3-4853-8fad-b2e3ea89607c {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1940308953',display_name='tempest-ServersNegativeTestJSON-server-1940308953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1940308953',id=11,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:52:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad83f3fea7fc4f308278ab8be165e86b',ramdisk_id='',reservation_id='r-0eay2bgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1521565055',owner_user_name='tempest-ServersNegativeTestJSON-1521565055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:52:23Z,user_data=None,user_id='fa0d70bee1b64b939678aec53d77c0fd',uuid=3d06fffa-bbb3-4853-8fad-b2e3ea89607c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43613540-5fba-41ad-8378-9f02b51dbf04", "address": "fa:16:3e:89:ed:59", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43613540-5f", "ovs_interfaceid": "43613540-5fba-41ad-8378-9f02b51dbf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Converting VIF {"id": "43613540-5fba-41ad-8378-9f02b51dbf04", "address": "fa:16:3e:89:ed:59", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43613540-5f", "ovs_interfaceid": "43613540-5fba-41ad-8378-9f02b51dbf04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:ed:59,bridge_name='br-int',has_traffic_filtering=True,id=43613540-5fba-41ad-8378-9f02b51dbf04,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43613540-5f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG os_vif [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ed:59,bridge_name='br-int',has_traffic_filtering=True,id=43613540-5fba-41ad-8378-9f02b51dbf04,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43613540-5f') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43613540-5f, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd969c0e-e6cf-4069-a638-96bb0f5c4140) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:05 user nova-compute[74278]: INFO os_vif [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:ed:59,bridge_name='br-int',has_traffic_filtering=True,id=43613540-5fba-41ad-8378-9f02b51dbf04,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43613540-5f')
Oct 30 10:54:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Deleting instance files /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c_del
Oct 30 10:54:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Deletion of /opt/stack/data/nova/instances/3d06fffa-bbb3-4853-8fad-b2e3ea89607c_del complete
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:06 user nova-compute[74278]: INFO nova.compute.manager [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Took 1.40 seconds to destroy the instance on the hypervisor.
Oct 30 10:54:06 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquired lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-vif-deleted-181a6ded-caac-4f51-ac21-3972c8cc8320 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:06 user nova-compute[74278]: INFO nova.compute.manager [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Neutron deleted interface 181a6ded-caac-4f51-ac21-3972c8cc8320; detaching it from the instance and deleting it from the info cache
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.network.neutron [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Updating instance_info_cache with network_info: [{"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.objects.instance [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] Lazy-loading 'system_metadata' on Instance uuid 0cecb81b-55ae-46de-8f32-433f2ff42bad {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.objects.instance [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] Lazy-loading 'flavor' on Instance uuid 0cecb81b-55ae-46de-8f32-433f2ff42bad {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.objects.base [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] Object Instance<0cecb81b-55ae-46de-8f32-433f2ff42bad> lazy-loaded attributes: system_metadata,flavor {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1244481291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1244481291',id=8,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hCZm+p9pneLXjvGF3q+uUILN9j75Q8EhDi66gIZTDo8x7vX6mAeb+cwmbpumy2JKJSnUtNn0gun7/lwnmnulLD1nk9wxII3Jt323IfPYgkyT8hzWa5M48LRz07jpuRw==',key_name='tempest-keypair-586447970',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:51:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='253f67cb486c46d1ad6e5ca4b1287893',ramdisk_id='',reservation_id='r-twe11yrb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-112217138',owner_user_name='tempest-TaggedAttachmentsTest-112217138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b046e419a34ce591eebd5c11332017',uuid=0cecb81b-55ae-46de-8f32-433f2ff42bad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.network.os_vif_util [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] Converting VIF {"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.network.os_vif_util [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:11:51,bridge_name='br-int',has_traffic_filtering=True,id=181a6ded-caac-4f51-ac21-3972c8cc8320,network=Network(8b040c63-4590-4a68-b47e-adf7aaba750f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6ded-ca') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:68:11:51"/><model type="virtio"/><mtu size="1442"/><target dev="tap181a6ded-ca"/></interface> {{(pid=74278) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:68:11:51"/><model type="virtio"/><mtu size="1442"/><target dev="tap181a6ded-ca"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 30 10:54:06 user nova-compute[74278]:   <name>instance-00000008</name>
Oct 30 10:54:06 user nova-compute[74278]:   <uuid>0cecb81b-55ae-46de-8f32-433f2ff42bad</uuid>
Oct 30 10:54:06 user nova-compute[74278]:   <metadata>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:54:06 user nova-compute[74278]:   <nova:package version="0.0.0"/>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:name>tempest-device-tagging-server-1244481291</nova:name>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:creationTime>2023-10-30 10:54:05</nova:creationTime>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:flavor name="m1.tiny">
Oct 30 10:54:06 user nova-compute[74278]:     <nova:memory>512</nova:memory>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:disk>1</nova:disk>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:swap>0</nova:swap>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:vcpus>1</nova:vcpus>
Oct 30 10:54:06 user nova-compute[74278]:   </nova:flavor>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:owner>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:user uuid="c6b046e419a34ce591eebd5c11332017">tempest-TaggedAttachmentsTest-112217138-project-member</nova:user>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:project uuid="253f67cb486c46d1ad6e5ca4b1287893">tempest-TaggedAttachmentsTest-112217138</nova:project>
Oct 30 10:54:06 user nova-compute[74278]:   </nova:owner>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:ports>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:port uuid="a719761e-73d6-414b-a6d5-68e6b757e402">
Oct 30 10:54:06 user nova-compute[74278]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 10:54:06 user nova-compute[74278]:     </nova:port>
Oct 30 10:54:06 user nova-compute[74278]:   </nova:ports>
Oct 30 10:54:06 user nova-compute[74278]: </nova:instance>
Oct 30 10:54:06 user nova-compute[74278]:   </metadata>
Oct 30 10:54:06 user nova-compute[74278]:   <memory unit='KiB'>524288</memory>
Oct 30 10:54:06 user nova-compute[74278]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 30 10:54:06 user nova-compute[74278]:   <vcpu placement='static'>1</vcpu>
Oct 30 10:54:06 user nova-compute[74278]:   <resource>
Oct 30 10:54:06 user nova-compute[74278]:     <partition>/machine</partition>
Oct 30 10:54:06 user nova-compute[74278]:   </resource>
Oct 30 10:54:06 user nova-compute[74278]:   <sysinfo type='smbios'>
Oct 30 10:54:06 user nova-compute[74278]:     <system>
Oct 30 10:54:06 user nova-compute[74278]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 30 10:54:06 user nova-compute[74278]:       <entry name='product'>OpenStack Nova</entry>
Oct 30 10:54:06 user nova-compute[74278]:       <entry name='version'>0.0.0</entry>
Oct 30 10:54:06 user nova-compute[74278]:       <entry name='serial'>0cecb81b-55ae-46de-8f32-433f2ff42bad</entry>
Oct 30 10:54:06 user nova-compute[74278]:       <entry name='uuid'>0cecb81b-55ae-46de-8f32-433f2ff42bad</entry>
Oct 30 10:54:06 user nova-compute[74278]:       <entry name='family'>Virtual Machine</entry>
Oct 30 10:54:06 user nova-compute[74278]:     </system>
Oct 30 10:54:06 user nova-compute[74278]:   </sysinfo>
Oct 30 10:54:06 user nova-compute[74278]:   <os>
Oct 30 10:54:06 user nova-compute[74278]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 30 10:54:06 user nova-compute[74278]:     <boot dev='hd'/>
Oct 30 10:54:06 user nova-compute[74278]:     <smbios mode='sysinfo'/>
Oct 30 10:54:06 user nova-compute[74278]:   </os>
Oct 30 10:54:06 user nova-compute[74278]:   <features>
Oct 30 10:54:06 user nova-compute[74278]:     <acpi/>
Oct 30 10:54:06 user nova-compute[74278]:     <apic/>
Oct 30 10:54:06 user nova-compute[74278]:     <vmcoreinfo state='on'/>
Oct 30 10:54:06 user nova-compute[74278]:   </features>
Oct 30 10:54:06 user nova-compute[74278]:   <cpu mode='custom' match='exact' check='full'>
Oct 30 10:54:06 user nova-compute[74278]:     <model fallback='forbid'>Nehalem</model>
Oct 30 10:54:06 user nova-compute[74278]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 30 10:54:06 user nova-compute[74278]:     <feature policy='require' name='vme'/>
Oct 30 10:54:06 user nova-compute[74278]:     <feature policy='require' name='x2apic'/>
Oct 30 10:54:06 user nova-compute[74278]:     <feature policy='require' name='hypervisor'/>
Oct 30 10:54:06 user nova-compute[74278]:   </cpu>
Oct 30 10:54:06 user nova-compute[74278]:   <clock offset='utc'>
Oct 30 10:54:06 user nova-compute[74278]:     <timer name='pit' tickpolicy='delay'/>
Oct 30 10:54:06 user nova-compute[74278]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 30 10:54:06 user nova-compute[74278]:     <timer name='hpet' present='no'/>
Oct 30 10:54:06 user nova-compute[74278]:   </clock>
Oct 30 10:54:06 user nova-compute[74278]:   <on_poweroff>destroy</on_poweroff>
Oct 30 10:54:06 user nova-compute[74278]:   <on_reboot>restart</on_reboot>
Oct 30 10:54:06 user nova-compute[74278]:   <on_crash>destroy</on_crash>
Oct 30 10:54:06 user nova-compute[74278]:   <devices>
Oct 30 10:54:06 user nova-compute[74278]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 10:54:06 user nova-compute[74278]:     <disk type='file' device='disk'>
Oct 30 10:54:06 user nova-compute[74278]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 30 10:54:06 user nova-compute[74278]:       <source file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk' index='2'/>
Oct 30 10:54:06 user nova-compute[74278]:       <backingStore type='file' index='3'>
Oct 30 10:54:06 user nova-compute[74278]:         <format type='raw'/>
Oct 30 10:54:06 user nova-compute[74278]:         <source file='/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0'/>
Oct 30 10:54:06 user nova-compute[74278]:         <backingStore/>
Oct 30 10:54:06 user nova-compute[74278]:       </backingStore>
Oct 30 10:54:06 user nova-compute[74278]:       <target dev='vda' bus='virtio'/>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='virtio-disk0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </disk>
Oct 30 10:54:06 user nova-compute[74278]:     <disk type='file' device='cdrom'>
Oct 30 10:54:06 user nova-compute[74278]:       <driver name='qemu' type='raw' cache='none'/>
Oct 30 10:54:06 user nova-compute[74278]:       <source file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk.config' index='1'/>
Oct 30 10:54:06 user nova-compute[74278]:       <backingStore/>
Oct 30 10:54:06 user nova-compute[74278]:       <target dev='hda' bus='ide'/>
Oct 30 10:54:06 user nova-compute[74278]:       <readonly/>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='ide0-0-0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </disk>
Oct 30 10:54:06 user nova-compute[74278]:     <controller type='usb' index='0' model='none'>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='usb'/>
Oct 30 10:54:06 user nova-compute[74278]:     </controller>
Oct 30 10:54:06 user nova-compute[74278]:     <controller type='pci' index='0' model='pci-root'>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='pci.0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </controller>
Oct 30 10:54:06 user nova-compute[74278]:     <controller type='ide' index='0'>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='ide'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 30 10:54:06 user nova-compute[74278]:     </controller>
Oct 30 10:54:06 user nova-compute[74278]:     <interface type='ethernet'>
Oct 30 10:54:06 user nova-compute[74278]:       <mac address='fa:16:3e:ac:42:07'/>
Oct 30 10:54:06 user nova-compute[74278]:       <target dev='tapa719761e-73'/>
Oct 30 10:54:06 user nova-compute[74278]:       <model type='virtio'/>
Oct 30 10:54:06 user nova-compute[74278]:       <mtu size='1442'/>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='net0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </interface>
Oct 30 10:54:06 user nova-compute[74278]:     <serial type='pty'>
Oct 30 10:54:06 user nova-compute[74278]:       <source path='/dev/pts/7'/>
Oct 30 10:54:06 user nova-compute[74278]:       <log file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/console.log' append='off'/>
Oct 30 10:54:06 user nova-compute[74278]:       <target type='isa-serial' port='0'>
Oct 30 10:54:06 user nova-compute[74278]:         <model name='isa-serial'/>
Oct 30 10:54:06 user nova-compute[74278]:       </target>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='serial0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </serial>
Oct 30 10:54:06 user nova-compute[74278]:     <console type='pty' tty='/dev/pts/7'>
Oct 30 10:54:06 user nova-compute[74278]:       <source path='/dev/pts/7'/>
Oct 30 10:54:06 user nova-compute[74278]:       <log file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/console.log' append='off'/>
Oct 30 10:54:06 user nova-compute[74278]:       <target type='serial' port='0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='serial0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </console>
Oct 30 10:54:06 user nova-compute[74278]:     <input type='mouse' bus='ps2'>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='input0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </input>
Oct 30 10:54:06 user nova-compute[74278]:     <input type='keyboard' bus='ps2'>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='input1'/>
Oct 30 10:54:06 user nova-compute[74278]:     </input>
Oct 30 10:54:06 user nova-compute[74278]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 30 10:54:06 user nova-compute[74278]:       <listen type='address' address='0.0.0.0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </graphics>
Oct 30 10:54:06 user nova-compute[74278]:     <audio id='1' type='none'/>
Oct 30 10:54:06 user nova-compute[74278]:     <video>
Oct 30 10:54:06 user nova-compute[74278]:       <model type='virtio' heads='1' primary='yes'/>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='video0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </video>
Oct 30 10:54:06 user nova-compute[74278]:     <memballoon model='virtio'>
Oct 30 10:54:06 user nova-compute[74278]:       <stats period='10'/>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='balloon0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </memballoon>
Oct 30 10:54:06 user nova-compute[74278]:     <rng model='virtio'>
Oct 30 10:54:06 user nova-compute[74278]:       <backend model='random'>/dev/urandom</backend>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='rng0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </rng>
Oct 30 10:54:06 user nova-compute[74278]:   </devices>
Oct 30 10:54:06 user nova-compute[74278]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 30 10:54:06 user nova-compute[74278]:     <label>libvirt-0cecb81b-55ae-46de-8f32-433f2ff42bad</label>
Oct 30 10:54:06 user nova-compute[74278]:     <imagelabel>libvirt-0cecb81b-55ae-46de-8f32-433f2ff42bad</imagelabel>
Oct 30 10:54:06 user nova-compute[74278]:   </seclabel>
Oct 30 10:54:06 user nova-compute[74278]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 30 10:54:06 user nova-compute[74278]:     <label>+64055:+108</label>
Oct 30 10:54:06 user nova-compute[74278]:     <imagelabel>+64055:+108</imagelabel>
Oct 30 10:54:06 user nova-compute[74278]:   </seclabel>
Oct 30 10:54:06 user nova-compute[74278]: </domain>
Oct 30 10:54:06 user nova-compute[74278]:  {{(pid=74278) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:68:11:51"/><model type="virtio"/><mtu size="1442"/><target dev="tap181a6ded-ca"/></interface> {{(pid=74278) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:68:11:51"/><model type="virtio"/><mtu size="1442"/><target dev="tap181a6ded-ca"/></interface>not found in domain: <domain type='kvm' id='8'>
Oct 30 10:54:06 user nova-compute[74278]:   <name>instance-00000008</name>
Oct 30 10:54:06 user nova-compute[74278]:   <uuid>0cecb81b-55ae-46de-8f32-433f2ff42bad</uuid>
Oct 30 10:54:06 user nova-compute[74278]:   <metadata>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:54:06 user nova-compute[74278]:   <nova:package version="0.0.0"/>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:name>tempest-device-tagging-server-1244481291</nova:name>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:creationTime>2023-10-30 10:54:05</nova:creationTime>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:flavor name="m1.tiny">
Oct 30 10:54:06 user nova-compute[74278]:     <nova:memory>512</nova:memory>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:disk>1</nova:disk>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:swap>0</nova:swap>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:vcpus>1</nova:vcpus>
Oct 30 10:54:06 user nova-compute[74278]:   </nova:flavor>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:owner>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:user uuid="c6b046e419a34ce591eebd5c11332017">tempest-TaggedAttachmentsTest-112217138-project-member</nova:user>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:project uuid="253f67cb486c46d1ad6e5ca4b1287893">tempest-TaggedAttachmentsTest-112217138</nova:project>
Oct 30 10:54:06 user nova-compute[74278]:   </nova:owner>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:ports>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:port uuid="a719761e-73d6-414b-a6d5-68e6b757e402">
Oct 30 10:54:06 user nova-compute[74278]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 10:54:06 user nova-compute[74278]:     </nova:port>
Oct 30 10:54:06 user nova-compute[74278]:   </nova:ports>
Oct 30 10:54:06 user nova-compute[74278]: </nova:instance>
Oct 30 10:54:06 user nova-compute[74278]:   </metadata>
Oct 30 10:54:06 user nova-compute[74278]:   <memory unit='KiB'>524288</memory>
Oct 30 10:54:06 user nova-compute[74278]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 30 10:54:06 user nova-compute[74278]:   <vcpu placement='static'>1</vcpu>
Oct 30 10:54:06 user nova-compute[74278]:   <resource>
Oct 30 10:54:06 user nova-compute[74278]:     <partition>/machine</partition>
Oct 30 10:54:06 user nova-compute[74278]:   </resource>
Oct 30 10:54:06 user nova-compute[74278]:   <sysinfo type='smbios'>
Oct 30 10:54:06 user nova-compute[74278]:     <system>
Oct 30 10:54:06 user nova-compute[74278]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 30 10:54:06 user nova-compute[74278]:       <entry name='product'>OpenStack Nova</entry>
Oct 30 10:54:06 user nova-compute[74278]:       <entry name='version'>0.0.0</entry>
Oct 30 10:54:06 user nova-compute[74278]:       <entry name='serial'>0cecb81b-55ae-46de-8f32-433f2ff42bad</entry>
Oct 30 10:54:06 user nova-compute[74278]:       <entry name='uuid'>0cecb81b-55ae-46de-8f32-433f2ff42bad</entry>
Oct 30 10:54:06 user nova-compute[74278]:       <entry name='family'>Virtual Machine</entry>
Oct 30 10:54:06 user nova-compute[74278]:     </system>
Oct 30 10:54:06 user nova-compute[74278]:   </sysinfo>
Oct 30 10:54:06 user nova-compute[74278]:   <os>
Oct 30 10:54:06 user nova-compute[74278]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 30 10:54:06 user nova-compute[74278]:     <boot dev='hd'/>
Oct 30 10:54:06 user nova-compute[74278]:     <smbios mode='sysinfo'/>
Oct 30 10:54:06 user nova-compute[74278]:   </os>
Oct 30 10:54:06 user nova-compute[74278]:   <features>
Oct 30 10:54:06 user nova-compute[74278]:     <acpi/>
Oct 30 10:54:06 user nova-compute[74278]:     <apic/>
Oct 30 10:54:06 user nova-compute[74278]:     <vmcoreinfo state='on'/>
Oct 30 10:54:06 user nova-compute[74278]:   </features>
Oct 30 10:54:06 user nova-compute[74278]:   <cpu mode='custom' match='exact' check='full'>
Oct 30 10:54:06 user nova-compute[74278]:     <model fallback='forbid'>Nehalem</model>
Oct 30 10:54:06 user nova-compute[74278]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 30 10:54:06 user nova-compute[74278]:     <feature policy='require' name='vme'/>
Oct 30 10:54:06 user nova-compute[74278]:     <feature policy='require' name='x2apic'/>
Oct 30 10:54:06 user nova-compute[74278]:     <feature policy='require' name='hypervisor'/>
Oct 30 10:54:06 user nova-compute[74278]:   </cpu>
Oct 30 10:54:06 user nova-compute[74278]:   <clock offset='utc'>
Oct 30 10:54:06 user nova-compute[74278]:     <timer name='pit' tickpolicy='delay'/>
Oct 30 10:54:06 user nova-compute[74278]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 30 10:54:06 user nova-compute[74278]:     <timer name='hpet' present='no'/>
Oct 30 10:54:06 user nova-compute[74278]:   </clock>
Oct 30 10:54:06 user nova-compute[74278]:   <on_poweroff>destroy</on_poweroff>
Oct 30 10:54:06 user nova-compute[74278]:   <on_reboot>restart</on_reboot>
Oct 30 10:54:06 user nova-compute[74278]:   <on_crash>destroy</on_crash>
Oct 30 10:54:06 user nova-compute[74278]:   <devices>
Oct 30 10:54:06 user nova-compute[74278]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 10:54:06 user nova-compute[74278]:     <disk type='file' device='disk'>
Oct 30 10:54:06 user nova-compute[74278]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 30 10:54:06 user nova-compute[74278]:       <source file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk' index='2'/>
Oct 30 10:54:06 user nova-compute[74278]:       <backingStore type='file' index='3'>
Oct 30 10:54:06 user nova-compute[74278]:         <format type='raw'/>
Oct 30 10:54:06 user nova-compute[74278]:         <source file='/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0'/>
Oct 30 10:54:06 user nova-compute[74278]:         <backingStore/>
Oct 30 10:54:06 user nova-compute[74278]:       </backingStore>
Oct 30 10:54:06 user nova-compute[74278]:       <target dev='vda' bus='virtio'/>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='virtio-disk0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </disk>
Oct 30 10:54:06 user nova-compute[74278]:     <disk type='file' device='cdrom'>
Oct 30 10:54:06 user nova-compute[74278]:       <driver name='qemu' type='raw' cache='none'/>
Oct 30 10:54:06 user nova-compute[74278]:       <source file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk.config' index='1'/>
Oct 30 10:54:06 user nova-compute[74278]:       <backingStore/>
Oct 30 10:54:06 user nova-compute[74278]:       <target dev='hda' bus='ide'/>
Oct 30 10:54:06 user nova-compute[74278]:       <readonly/>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='ide0-0-0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </disk>
Oct 30 10:54:06 user nova-compute[74278]:     <controller type='usb' index='0' model='none'>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='usb'/>
Oct 30 10:54:06 user nova-compute[74278]:     </controller>
Oct 30 10:54:06 user nova-compute[74278]:     <controller type='pci' index='0' model='pci-root'>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='pci.0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </controller>
Oct 30 10:54:06 user nova-compute[74278]:     <controller type='ide' index='0'>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='ide'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 30 10:54:06 user nova-compute[74278]:     </controller>
Oct 30 10:54:06 user nova-compute[74278]:     <interface type='ethernet'>
Oct 30 10:54:06 user nova-compute[74278]:       <mac address='fa:16:3e:ac:42:07'/>
Oct 30 10:54:06 user nova-compute[74278]:       <target dev='tapa719761e-73'/>
Oct 30 10:54:06 user nova-compute[74278]:       <model type='virtio'/>
Oct 30 10:54:06 user nova-compute[74278]:       <mtu size='1442'/>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='net0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </interface>
Oct 30 10:54:06 user nova-compute[74278]:     <serial type='pty'>
Oct 30 10:54:06 user nova-compute[74278]:       <source path='/dev/pts/7'/>
Oct 30 10:54:06 user nova-compute[74278]:       <log file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/console.log' append='off'/>
Oct 30 10:54:06 user nova-compute[74278]:       <target type='isa-serial' port='0'>
Oct 30 10:54:06 user nova-compute[74278]:         <model name='isa-serial'/>
Oct 30 10:54:06 user nova-compute[74278]:       </target>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='serial0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </serial>
Oct 30 10:54:06 user nova-compute[74278]:     <console type='pty' tty='/dev/pts/7'>
Oct 30 10:54:06 user nova-compute[74278]:       <source path='/dev/pts/7'/>
Oct 30 10:54:06 user nova-compute[74278]:       <log file='/opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/console.log' append='off'/>
Oct 30 10:54:06 user nova-compute[74278]:       <target type='serial' port='0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='serial0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </console>
Oct 30 10:54:06 user nova-compute[74278]:     <input type='mouse' bus='ps2'>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='input0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </input>
Oct 30 10:54:06 user nova-compute[74278]:     <input type='keyboard' bus='ps2'>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='input1'/>
Oct 30 10:54:06 user nova-compute[74278]:     </input>
Oct 30 10:54:06 user nova-compute[74278]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Oct 30 10:54:06 user nova-compute[74278]:       <listen type='address' address='0.0.0.0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </graphics>
Oct 30 10:54:06 user nova-compute[74278]:     <audio id='1' type='none'/>
Oct 30 10:54:06 user nova-compute[74278]:     <video>
Oct 30 10:54:06 user nova-compute[74278]:       <model type='virtio' heads='1' primary='yes'/>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='video0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </video>
Oct 30 10:54:06 user nova-compute[74278]:     <memballoon model='virtio'>
Oct 30 10:54:06 user nova-compute[74278]:       <stats period='10'/>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='balloon0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </memballoon>
Oct 30 10:54:06 user nova-compute[74278]:     <rng model='virtio'>
Oct 30 10:54:06 user nova-compute[74278]:       <backend model='random'>/dev/urandom</backend>
Oct 30 10:54:06 user nova-compute[74278]:       <alias name='rng0'/>
Oct 30 10:54:06 user nova-compute[74278]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 30 10:54:06 user nova-compute[74278]:     </rng>
Oct 30 10:54:06 user nova-compute[74278]:   </devices>
Oct 30 10:54:06 user nova-compute[74278]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 30 10:54:06 user nova-compute[74278]:     <label>libvirt-0cecb81b-55ae-46de-8f32-433f2ff42bad</label>
Oct 30 10:54:06 user nova-compute[74278]:     <imagelabel>libvirt-0cecb81b-55ae-46de-8f32-433f2ff42bad</imagelabel>
Oct 30 10:54:06 user nova-compute[74278]:   </seclabel>
Oct 30 10:54:06 user nova-compute[74278]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 30 10:54:06 user nova-compute[74278]:     <label>+64055:+108</label>
Oct 30 10:54:06 user nova-compute[74278]:     <imagelabel>+64055:+108</imagelabel>
Oct 30 10:54:06 user nova-compute[74278]:   </seclabel>
Oct 30 10:54:06 user nova-compute[74278]: </domain>
Oct 30 10:54:06 user nova-compute[74278]:  {{(pid=74278) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 30 10:54:06 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Detaching interface fa:16:3e:68:11:51 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap181a6ded-ca' not found.
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1244481291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1244481291',id=8,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hCZm+p9pneLXjvGF3q+uUILN9j75Q8EhDi66gIZTDo8x7vX6mAeb+cwmbpumy2JKJSnUtNn0gun7/lwnmnulLD1nk9wxII3Jt323IfPYgkyT8hzWa5M48LRz07jpuRw==',key_name='tempest-keypair-586447970',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:51:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='253f67cb486c46d1ad6e5ca4b1287893',ramdisk_id='',reservation_id='r-twe11yrb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-112217138',owner_user_name='tempest-TaggedAttachmentsTest-112217138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b046e419a34ce591eebd5c11332017',uuid=0cecb81b-55ae-46de-8f32-433f2ff42bad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.network.os_vif_util [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] Converting VIF {"id": "181a6ded-caac-4f51-ac21-3972c8cc8320", "address": "fa:16:3e:68:11:51", "network": {"id": "8b040c63-4590-4a68-b47e-adf7aaba750f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-33493771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181a6ded-ca", "ovs_interfaceid": "181a6ded-caac-4f51-ac21-3972c8cc8320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.network.os_vif_util [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:11:51,bridge_name='br-int',has_traffic_filtering=True,id=181a6ded-caac-4f51-ac21-3972c8cc8320,network=Network(8b040c63-4590-4a68-b47e-adf7aaba750f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6ded-ca') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG os_vif [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:11:51,bridge_name='br-int',has_traffic_filtering=True,id=181a6ded-caac-4f51-ac21-3972c8cc8320,network=Network(8b040c63-4590-4a68-b47e-adf7aaba750f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6ded-ca') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap181a6ded-ca, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.objects.instance [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lazy-loading 'flavor' on Instance uuid 21d2a8cc-39ee-435e-9936-d1585a9386b7 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:06 user nova-compute[74278]: INFO os_vif [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:11:51,bridge_name='br-int',has_traffic_filtering=True,id=181a6ded-caac-4f51-ac21-3972c8cc8320,network=Network(8b040c63-4590-4a68-b47e-adf7aaba750f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181a6ded-ca')
Oct 30 10:54:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [req-5fa9e4bc-b312-479f-b304-12b461e36fee req-6b8d97bc-137c-4610-b66f-9da05d6a86da service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:54:06 user nova-compute[74278]:   <nova:package version="0.0.0"/>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:name>tempest-device-tagging-server-1244481291</nova:name>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:creationTime>2023-10-30 10:54:06</nova:creationTime>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:flavor name="m1.tiny">
Oct 30 10:54:06 user nova-compute[74278]:     <nova:memory>512</nova:memory>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:disk>1</nova:disk>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:swap>0</nova:swap>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:vcpus>1</nova:vcpus>
Oct 30 10:54:06 user nova-compute[74278]:   </nova:flavor>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:owner>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:user uuid="c6b046e419a34ce591eebd5c11332017">tempest-TaggedAttachmentsTest-112217138-project-member</nova:user>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:project uuid="253f67cb486c46d1ad6e5ca4b1287893">tempest-TaggedAttachmentsTest-112217138</nova:project>
Oct 30 10:54:06 user nova-compute[74278]:   </nova:owner>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:54:06 user nova-compute[74278]:   <nova:ports>
Oct 30 10:54:06 user nova-compute[74278]:     <nova:port uuid="a719761e-73d6-414b-a6d5-68e6b757e402">
Oct 30 10:54:06 user nova-compute[74278]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 10:54:06 user nova-compute[74278]:     </nova:port>
Oct 30 10:54:06 user nova-compute[74278]:   </nova:ports>
Oct 30 10:54:06 user nova-compute[74278]: </nova:instance>
Oct 30 10:54:06 user nova-compute[74278]:  {{(pid=74278) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 30 10:54:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5e429379-08fe-4d75-aed4-6bf61c281f7a tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.509s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-bda6976b-8abd-4056-8f44-84e268d94851 req-90de1d76-fe9c-453e-814e-86e011f9e4fc service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bda6976b-8abd-4056-8f44-84e268d94851 req-90de1d76-fe9c-453e-814e-86e011f9e4fc service nova] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bda6976b-8abd-4056-8f44-84e268d94851 req-90de1d76-fe9c-453e-814e-86e011f9e4fc service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bda6976b-8abd-4056-8f44-84e268d94851 req-90de1d76-fe9c-453e-814e-86e011f9e4fc service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-bda6976b-8abd-4056-8f44-84e268d94851 req-90de1d76-fe9c-453e-814e-86e011f9e4fc service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] No waiting events found dispatching network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:07 user nova-compute[74278]: WARNING nova.compute.manager [req-bda6976b-8abd-4056-8f44-84e268d94851 req-90de1d76-fe9c-453e-814e-86e011f9e4fc service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received unexpected event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb for instance with vm_state building and task_state spawning.
Oct 30 10:54:07 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:07 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Took 1.42 seconds to deallocate network for instance.
Oct 30 10:54:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:07 user nova-compute[74278]: INFO nova.network.neutron [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Port 181a6ded-caac-4f51-ac21-3972c8cc8320 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 30 10:54:07 user nova-compute[74278]: DEBUG nova.network.neutron [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Updating instance_info_cache with network_info: [{"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Releasing lock "refresh_cache-0cecb81b-55ae-46de-8f32-433f2ff42bad" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:54:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63346399-5c03-44aa-84d3-10dfe1c8ce7d tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "interface-0cecb81b-55ae-46de-8f32-433f2ff42bad-181a6ded-caac-4f51-ac21-3972c8cc8320" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.755s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:07 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:54:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:54:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Instance spawned successfully.
Oct 30 10:54:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:54:07 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:54:08 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance spawned successfully.
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.543s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:08 user nova-compute[74278]: INFO nova.compute.manager [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Took 8.23 seconds to spawn the instance on the hypervisor.
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:54:08 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Deleted allocations for instance 3d06fffa-bbb3-4853-8fad-b2e3ea89607c
Oct 30 10:54:08 user nova-compute[74278]: INFO nova.compute.manager [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Took 8.27 seconds to spawn the instance on the hypervisor.
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:54:08 user nova-compute[74278]: INFO nova.compute.manager [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Took 45.51 seconds to build instance.
Oct 30 10:54:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c8a70a58-345f-46b7-9f25-93600faaeaac tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "2591f731-03b7-49b6-93af-c5b63e505127" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.695s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4cc7bbca-43de-46a0-9783-c3c827ec5ae6 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "3d06fffa-bbb3-4853-8fad-b2e3ea89607c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.710s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:08 user nova-compute[74278]: INFO nova.compute.manager [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Took 9.19 seconds to build instance.
Oct 30 10:54:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5ffe7912-9125-41e0-bf7d-9cf58a139fed tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.321s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] No waiting events found dispatching network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:08 user nova-compute[74278]: WARNING nova.compute.manager [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received unexpected event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 for instance with vm_state active and task_state None.
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] No waiting events found dispatching network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:08 user nova-compute[74278]: WARNING nova.compute.manager [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received unexpected event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 for instance with vm_state active and task_state None.
Oct 30 10:54:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c0dc336a-5d97-42c6-96f9-82132ca8b1c6 req-772cfec3-148e-4409-ac31-6c38510829da service nova] [instance: 3d06fffa-bbb3-4853-8fad-b2e3ea89607c] Received event network-vif-deleted-43613540-5fba-41ad-8378-9f02b51dbf04 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:54:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:54:16 user nova-compute[74278]: INFO nova.compute.claims [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Claim successful on node user
Oct 30 10:54:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:16 user nova-compute[74278]: DEBUG nova.objects.instance [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lazy-loading 'flavor' on Instance uuid 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:17 user nova-compute[74278]: INFO nova.compute.manager [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Attaching volume e0066f51-c274-4eea-9f0c-8acdcded086c to /dev/vdb
Oct 30 10:54:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:54:17 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:54:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG os_brick.utils [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4110fa2d-e352-4b99-b325-7343e346fd51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG nova.policy [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c4560d0bf034d30a8d8d6fac7d347f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba4eff185f543aa8c590fe74f59c7b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec6eac5-fe76-4070-947b-8a429dd2cba5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d85918-855e-4806-8593-10d06c8c98af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b1820e-8d38-45de-a06e-eaff52e365c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:54:17 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Creating image(s)
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "/opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "/opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:54:17 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7444ebe5-b1ba-499a-a7c5-e6bbaaa51ea7]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG os_brick.utils [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating existing volume attachment record: 5ced9292-bc2c-410d-8d30-9cdb995443de {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.248s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk 1073741824" returned: 0 in 0.050s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Successfully created port: 61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.205s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.354s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Cannot resize image /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Ensure instance console log exists: /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Successfully updated port: 61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquired lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:54:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-636d03fe-716e-437b-89ce-c406b816b85d req-ec1b1f04-3531-475e-94c0-e77de2a78f86 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Received event network-changed-61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-636d03fe-716e-437b-89ce-c406b816b85d req-ec1b1f04-3531-475e-94c0-e77de2a78f86 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Refreshing instance network info cache due to event network-changed-61fae496-e8ce-41d0-99e9-f718e37e8ff6. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-636d03fe-716e-437b-89ce-c406b816b85d req-ec1b1f04-3531-475e-94c0-e77de2a78f86 service nova] Acquiring lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.network.neutron [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.network.neutron [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Updating instance_info_cache with network_info: [{"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Releasing lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.compute.manager [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Instance network_info: |[{"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-636d03fe-716e-437b-89ce-c406b816b85d req-ec1b1f04-3531-475e-94c0-e77de2a78f86 service nova] Acquired lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.network.neutron [req-636d03fe-716e-437b-89ce-c406b816b85d req-ec1b1f04-3531-475e-94c0-e77de2a78f86 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Refreshing network info cache for port 61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Start _get_guest_xml network_info=[{"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:54:19 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:54:19 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:54:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:54:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1141231956',display_name='tempest-TestStampPattern-server-1141231956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1141231956',id=15,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErJIPGly6W6lNejwEf8DtSNy5OrG6xfE/nDhPvCgU8od+RfEYPhZ5Qc+GqAO9q9/7KpAJWL/Kivlo794MTyR38r0U10CkXp6EajAwqkYjjkVym0Mb+QFcYi/6SagifxZw==',key_name='tempest-TestStampPattern-1979010860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba4eff185f543aa8c590fe74f59c7b8',ramdisk_id='',reservation_id='r-706gquao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1462524641',owner_user_name='tempest-TestStampPattern-1462524641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:54:17Z,user_data=None,user_id='0c4560d0bf034d30a8d8d6fac7d347f8',uuid=9cba7c39-a2d1-44c0-a866-01c22a3f3634,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Converting VIF {"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b7:d3,bridge_name='br-int',has_traffic_filtering=True,id=61fae496-e8ce-41d0-99e9-f718e37e8ff6,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fae496-e8') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.objects.instance [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cba7c39-a2d1-44c0-a866-01c22a3f3634 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:54:20 user nova-compute[74278]:   <uuid>9cba7c39-a2d1-44c0-a866-01c22a3f3634</uuid>
Oct 30 10:54:20 user nova-compute[74278]:   <name>instance-0000000f</name>
Oct 30 10:54:20 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:54:20 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:54:20 user nova-compute[74278]:   <metadata>
Oct 30 10:54:20 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:54:20 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:54:20 user nova-compute[74278]:       <nova:name>tempest-TestStampPattern-server-1141231956</nova:name>
Oct 30 10:54:20 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:54:19</nova:creationTime>
Oct 30 10:54:20 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:54:20 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:54:20 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:54:20 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:54:20 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:54:20 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:54:20 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:54:20 user nova-compute[74278]:       <nova:owner>
Oct 30 10:54:20 user nova-compute[74278]:         <nova:user uuid="0c4560d0bf034d30a8d8d6fac7d347f8">tempest-TestStampPattern-1462524641-project-member</nova:user>
Oct 30 10:54:20 user nova-compute[74278]:         <nova:project uuid="0ba4eff185f543aa8c590fe74f59c7b8">tempest-TestStampPattern-1462524641</nova:project>
Oct 30 10:54:20 user nova-compute[74278]:       </nova:owner>
Oct 30 10:54:20 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:54:20 user nova-compute[74278]:       <nova:ports>
Oct 30 10:54:20 user nova-compute[74278]:         <nova:port uuid="61fae496-e8ce-41d0-99e9-f718e37e8ff6">
Oct 30 10:54:20 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 10:54:20 user nova-compute[74278]:         </nova:port>
Oct 30 10:54:20 user nova-compute[74278]:       </nova:ports>
Oct 30 10:54:20 user nova-compute[74278]:     </nova:instance>
Oct 30 10:54:20 user nova-compute[74278]:   </metadata>
Oct 30 10:54:20 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:54:20 user nova-compute[74278]:     <system>
Oct 30 10:54:20 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:54:20 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:54:20 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:54:20 user nova-compute[74278]:       <entry name="serial">9cba7c39-a2d1-44c0-a866-01c22a3f3634</entry>
Oct 30 10:54:20 user nova-compute[74278]:       <entry name="uuid">9cba7c39-a2d1-44c0-a866-01c22a3f3634</entry>
Oct 30 10:54:20 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:54:20 user nova-compute[74278]:     </system>
Oct 30 10:54:20 user nova-compute[74278]:   </sysinfo>
Oct 30 10:54:20 user nova-compute[74278]:   <os>
Oct 30 10:54:20 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:54:20 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:54:20 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:54:20 user nova-compute[74278]:   </os>
Oct 30 10:54:20 user nova-compute[74278]:   <features>
Oct 30 10:54:20 user nova-compute[74278]:     <acpi/>
Oct 30 10:54:20 user nova-compute[74278]:     <apic/>
Oct 30 10:54:20 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:54:20 user nova-compute[74278]:   </features>
Oct 30 10:54:20 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:54:20 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:54:20 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:54:20 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:54:20 user nova-compute[74278]:   </clock>
Oct 30 10:54:20 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:54:20 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:54:20 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:54:20 user nova-compute[74278]:   </cpu>
Oct 30 10:54:20 user nova-compute[74278]:   <devices>
Oct 30 10:54:20 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:54:20 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:54:20 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk"/>
Oct 30 10:54:20 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:54:20 user nova-compute[74278]:     </disk>
Oct 30 10:54:20 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:54:20 user nova-compute[74278]:       <mac address="fa:16:3e:0d:b7:d3"/>
Oct 30 10:54:20 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:54:20 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:54:20 user nova-compute[74278]:       <target dev="tap61fae496-e8"/>
Oct 30 10:54:20 user nova-compute[74278]:     </interface>
Oct 30 10:54:20 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:54:20 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/console.log" append="off"/>
Oct 30 10:54:20 user nova-compute[74278]:     </serial>
Oct 30 10:54:20 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:54:20 user nova-compute[74278]:     <video>
Oct 30 10:54:20 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:54:20 user nova-compute[74278]:     </video>
Oct 30 10:54:20 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:54:20 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:54:20 user nova-compute[74278]:     </rng>
Oct 30 10:54:20 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:54:20 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:54:20 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:54:20 user nova-compute[74278]:     </memballoon>
Oct 30 10:54:20 user nova-compute[74278]:   </devices>
Oct 30 10:54:20 user nova-compute[74278]: </domain>
Oct 30 10:54:20 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:54:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1141231956',display_name='tempest-TestStampPattern-server-1141231956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1141231956',id=15,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErJIPGly6W6lNejwEf8DtSNy5OrG6xfE/nDhPvCgU8od+RfEYPhZ5Qc+GqAO9q9/7KpAJWL/Kivlo794MTyR38r0U10CkXp6EajAwqkYjjkVym0Mb+QFcYi/6SagifxZw==',key_name='tempest-TestStampPattern-1979010860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba4eff185f543aa8c590fe74f59c7b8',ramdisk_id='',reservation_id='r-706gquao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1462524641',owner_user_name='tempest-TestStampPattern-1462524641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:54:17Z,user_data=None,user_id='0c4560d0bf034d30a8d8d6fac7d347f8',uuid=9cba7c39-a2d1-44c0-a866-01c22a3f3634,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Converting VIF {"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b7:d3,bridge_name='br-int',has_traffic_filtering=True,id=61fae496-e8ce-41d0-99e9-f718e37e8ff6,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fae496-e8') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG os_vif [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b7:d3,bridge_name='br-int',has_traffic_filtering=True,id=61fae496-e8ce-41d0-99e9-f718e37e8ff6,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fae496-e8') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f21113ae-2ba0-5898-828e-f347beac43c1', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61fae496-e8, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61fae496-e8, col_values=(('qos', UUID('e1af4024-7153-4b8f-9a96-f34dba1e2f3c')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61fae496-e8, col_values=(('external_ids', {'iface-id': '61fae496-e8ce-41d0-99e9-f718e37e8ff6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:b7:d3', 'vm-uuid': '9cba7c39-a2d1-44c0-a866-01c22a3f3634'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:20 user nova-compute[74278]: INFO os_vif [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:b7:d3,bridge_name='br-int',has_traffic_filtering=True,id=61fae496-e8ce-41d0-99e9-f718e37e8ff6,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fae496-e8')
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] No VIF found with MAC fa:16:3e:0d:b7:d3, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating instance_info_cache with network_info: [{"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.network.neutron [req-636d03fe-716e-437b-89ce-c406b816b85d req-ec1b1f04-3531-475e-94c0-e77de2a78f86 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Updated VIF entry in instance network info cache for port 61fae496-e8ce-41d0-99e9-f718e37e8ff6. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG nova.network.neutron [req-636d03fe-716e-437b-89ce-c406b816b85d req-ec1b1f04-3531-475e-94c0-e77de2a78f86 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Updating instance_info_cache with network_info: [{"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-636d03fe-716e-437b-89ce-c406b816b85d req-ec1b1f04-3531-475e-94c0-e77de2a78f86 service nova] Releasing lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:54:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-971d286e-a588-4800-a701-09be6fcc7d28 req-794c61dd-f167-4ec9-98ff-2c12de3633a9 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Received event network-vif-plugged-61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-971d286e-a588-4800-a701-09be6fcc7d28 req-794c61dd-f167-4ec9-98ff-2c12de3633a9 service nova] Acquiring lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-971d286e-a588-4800-a701-09be6fcc7d28 req-794c61dd-f167-4ec9-98ff-2c12de3633a9 service nova] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-971d286e-a588-4800-a701-09be6fcc7d28 req-794c61dd-f167-4ec9-98ff-2c12de3633a9 service nova] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-971d286e-a588-4800-a701-09be6fcc7d28 req-794c61dd-f167-4ec9-98ff-2c12de3633a9 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] No waiting events found dispatching network-vif-plugged-61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:21 user nova-compute[74278]: WARNING nova.compute.manager [req-971d286e-a588-4800-a701-09be6fcc7d28 req-794c61dd-f167-4ec9-98ff-2c12de3633a9 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Received unexpected event network-vif-plugged-61fae496-e8ce-41d0-99e9-f718e37e8ff6 for instance with vm_state building and task_state spawning.
Oct 30 10:54:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:54:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:54:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:54:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:54:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-878357f8-a43e-4f10-9880-01af6c56bbf7 req-75eb4b7f-1537-4959-a132-fd37fba74830 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Received event network-vif-plugged-61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-878357f8-a43e-4f10-9880-01af6c56bbf7 req-75eb4b7f-1537-4959-a132-fd37fba74830 service nova] Acquiring lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-878357f8-a43e-4f10-9880-01af6c56bbf7 req-75eb4b7f-1537-4959-a132-fd37fba74830 service nova] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-878357f8-a43e-4f10-9880-01af6c56bbf7 req-75eb4b7f-1537-4959-a132-fd37fba74830 service nova] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-878357f8-a43e-4f10-9880-01af6c56bbf7 req-75eb4b7f-1537-4959-a132-fd37fba74830 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] No waiting events found dispatching network-vif-plugged-61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:23 user nova-compute[74278]: WARNING nova.compute.manager [req-878357f8-a43e-4f10-9880-01af6c56bbf7 req-75eb4b7f-1537-4959-a132-fd37fba74830 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Received unexpected event network-vif-plugged-61fae496-e8ce-41d0-99e9-f718e37e8ff6 for instance with vm_state building and task_state spawning.
Oct 30 10:54:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:54:24 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Instance spawned successfully.
Oct 30 10:54:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:24 user nova-compute[74278]: INFO nova.compute.manager [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Took 6.80 seconds to spawn the instance on the hypervisor.
Oct 30 10:54:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:54:24 user nova-compute[74278]: INFO nova.compute.manager [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Took 7.82 seconds to build instance.
Oct 30 10:54:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-87a2296c-c2d6-4ef6-bcad-fa73652db399 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.928s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:54:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:27 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:54:27 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7387MB free_disk=25.255455017089844GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 55cf7cd9-4e0b-4caa-874e-4963079e3b10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 84448e30-982f-4214-a61e-8cc5e122aef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0cecb81b-55ae-46de-8f32-433f2ff42bad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance d71474f7-0b91-49e5-b03b-56628ae7823e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 3c26a595-b269-44b0-bf02-43b6b768183e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9b6f739d-461c-48a4-a4a7-5eebbca38913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:54:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.711s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:54:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:54:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:54:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:35 user nova-compute[74278]: INFO nova.compute.manager [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Terminating instance
Oct 30 10:54:35 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:54:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "b5d47df1-5569-433d-bf6a-42b5e04196fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:54:36 user nova-compute[74278]: INFO nova.compute.claims [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Claim successful on node user
Oct 30 10:54:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-6a4d1b67-e411-4849-934d-587af9056798 req-e58de3c1-1c87-4e6c-b2c9-fe5557d15792 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-vif-unplugged-a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6a4d1b67-e411-4849-934d-587af9056798 req-e58de3c1-1c87-4e6c-b2c9-fe5557d15792 service nova] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6a4d1b67-e411-4849-934d-587af9056798 req-e58de3c1-1c87-4e6c-b2c9-fe5557d15792 service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6a4d1b67-e411-4849-934d-587af9056798 req-e58de3c1-1c87-4e6c-b2c9-fe5557d15792 service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-6a4d1b67-e411-4849-934d-587af9056798 req-e58de3c1-1c87-4e6c-b2c9-fe5557d15792 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] No waiting events found dispatching network-vif-unplugged-a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-6a4d1b67-e411-4849-934d-587af9056798 req-e58de3c1-1c87-4e6c-b2c9-fe5557d15792 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-vif-unplugged-a719761e-73d6-414b-a6d5-68e6b757e402 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:54:36 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Instance destroyed successfully.
Oct 30 10:54:36 user nova-compute[74278]: DEBUG nova.objects.instance [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lazy-loading 'resources' on Instance uuid 0cecb81b-55ae-46de-8f32-433f2ff42bad {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1244481291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1244481291',id=8,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hCZm+p9pneLXjvGF3q+uUILN9j75Q8EhDi66gIZTDo8x7vX6mAeb+cwmbpumy2JKJSnUtNn0gun7/lwnmnulLD1nk9wxII3Jt323IfPYgkyT8hzWa5M48LRz07jpuRw==',key_name='tempest-keypair-586447970',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:51:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='253f67cb486c46d1ad6e5ca4b1287893',ramdisk_id='',reservation_id='r-twe11yrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-112217138',owner_user_name='tempest-TaggedAttachmentsTest-112217138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6b046e419a34ce591eebd5c11332017',uuid=0cecb81b-55ae-46de-8f32-433f2ff42bad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converting VIF {"id": "a719761e-73d6-414b-a6d5-68e6b757e402", "address": "fa:16:3e:ac:42:07", "network": {"id": "65e6aab6-ebd9-4eeb-9303-21c55651f642", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-411625681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "253f67cb486c46d1ad6e5ca4b1287893", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa719761e-73", "ovs_interfaceid": "a719761e-73d6-414b-a6d5-68e6b757e402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:42:07,bridge_name='br-int',has_traffic_filtering=True,id=a719761e-73d6-414b-a6d5-68e6b757e402,network=Network(65e6aab6-ebd9-4eeb-9303-21c55651f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa719761e-73') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG os_vif [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:42:07,bridge_name='br-int',has_traffic_filtering=True,id=a719761e-73d6-414b-a6d5-68e6b757e402,network=Network(65e6aab6-ebd9-4eeb-9303-21c55651f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa719761e-73') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa719761e-73, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f54ad5b0-53c8-44d5-a91c-44925bbe88fc) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:36 user nova-compute[74278]: INFO os_vif [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:42:07,bridge_name='br-int',has_traffic_filtering=True,id=a719761e-73d6-414b-a6d5-68e6b757e402,network=Network(65e6aab6-ebd9-4eeb-9303-21c55651f642),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa719761e-73')
Oct 30 10:54:36 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Deleting instance files /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad_del
Oct 30 10:54:36 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Deletion of /opt/stack/data/nova/instances/0cecb81b-55ae-46de-8f32-433f2ff42bad_del complete
Oct 30 10:54:36 user nova-compute[74278]: INFO nova.compute.manager [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 30 10:54:36 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:54:36 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.708s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:54:37 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:54:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG nova.policy [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d00cea0f58247448d911d841ef601d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02150e63eb6442ecaf9377edc9036949', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:54:37 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Creating image(s)
Oct 30 10:54:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "/opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "/opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.268s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.254s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk 1073741824" returned: 0 in 0.064s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.215s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:38 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Took 1.66 seconds to deallocate network for instance.
Oct 30 10:54:38 user nova-compute[74278]: DEBUG nova.compute.manager [req-8e7ee130-22a5-4dc6-a23e-ba60646636ae req-535a90e6-70c7-4c5a-bd9a-76006aaf0ed4 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-vif-deleted-a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Cannot resize image /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Ensure instance console log exists: /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG nova.compute.manager [req-43c853a2-d4ef-49b9-b046-5d3ef33d0cd4 req-c07a9c88-87de-4371-9d05-77f385a5c870 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received event network-vif-plugged-a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-43c853a2-d4ef-49b9-b046-5d3ef33d0cd4 req-c07a9c88-87de-4371-9d05-77f385a5c870 service nova] Acquiring lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-43c853a2-d4ef-49b9-b046-5d3ef33d0cd4 req-c07a9c88-87de-4371-9d05-77f385a5c870 service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-43c853a2-d4ef-49b9-b046-5d3ef33d0cd4 req-c07a9c88-87de-4371-9d05-77f385a5c870 service nova] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG nova.compute.manager [req-43c853a2-d4ef-49b9-b046-5d3ef33d0cd4 req-c07a9c88-87de-4371-9d05-77f385a5c870 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] No waiting events found dispatching network-vif-plugged-a719761e-73d6-414b-a6d5-68e6b757e402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:38 user nova-compute[74278]: WARNING nova.compute.manager [req-43c853a2-d4ef-49b9-b046-5d3ef33d0cd4 req-c07a9c88-87de-4371-9d05-77f385a5c870 service nova] [instance: 0cecb81b-55ae-46de-8f32-433f2ff42bad] Received unexpected event network-vif-plugged-a719761e-73d6-414b-a6d5-68e6b757e402 for instance with vm_state deleted and task_state None.
Oct 30 10:54:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:38 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Successfully created port: ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:54:39 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:54:39 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:54:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.534s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:39 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Deleted allocations for instance 0cecb81b-55ae-46de-8f32-433f2ff42bad
Oct 30 10:54:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f3b963af-f58b-4d25-8c43-5ed075f10a30 tempest-TaggedAttachmentsTest-112217138 tempest-TaggedAttachmentsTest-112217138-project-member] Lock "0cecb81b-55ae-46de-8f32-433f2ff42bad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.512s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:39 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Successfully updated port: ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:54:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "refresh_cache-b5d47df1-5569-433d-bf6a-42b5e04196fa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:54:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquired lock "refresh_cache-b5d47df1-5569-433d-bf6a-42b5e04196fa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:54:39 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Updating instance_info_cache with network_info: [{"id": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "address": "fa:16:3e:f4:b6:68", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc4c9e5-40", "ovs_interfaceid": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Releasing lock "refresh_cache-b5d47df1-5569-433d-bf6a-42b5e04196fa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Instance network_info: |[{"id": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "address": "fa:16:3e:f4:b6:68", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc4c9e5-40", "ovs_interfaceid": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Start _get_guest_xml network_info=[{"id": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "address": "fa:16:3e:f4:b6:68", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc4c9e5-40", "ovs_interfaceid": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:54:40 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:54:40 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-437004539',display_name='tempest-VolumesAdminNegativeTest-server-437004539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-437004539',id=16,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02150e63eb6442ecaf9377edc9036949',ramdisk_id='',reservation_id='r-tyblzwm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-358317095',owner_user_name='tempest-VolumesAdminNegativeTest-358317095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:54:37Z,user_data=None,user_id='3d00cea0f58247448d911d841ef601d2',uuid=b5d47df1-5569-433d-bf6a-42b5e04196fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "address": "fa:16:3e:f4:b6:68", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc4c9e5-40", "ovs_interfaceid": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Converting VIF {"id": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "address": "fa:16:3e:f4:b6:68", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc4c9e5-40", "ovs_interfaceid": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc4c9e5-40') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lazy-loading 'pci_devices' on Instance uuid b5d47df1-5569-433d-bf6a-42b5e04196fa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxUyZTWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:54:40 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:54:40 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:54:40 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:54:40 user nova-compute[74278]:   <uuid>b5d47df1-5569-433d-bf6a-42b5e04196fa</uuid>
Oct 30 10:54:40 user nova-compute[74278]:   <name>instance-00000010</name>
Oct 30 10:54:40 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:54:40 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:54:40 user nova-compute[74278]:   <metadata>
Oct 30 10:54:40 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:54:40 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:54:40 user nova-compute[74278]:       <nova:name>tempest-VolumesAdminNegativeTest-server-437004539</nova:name>
Oct 30 10:54:40 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:54:40</nova:creationTime>
Oct 30 10:54:40 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:54:40 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:54:40 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:54:40 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:54:40 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:54:40 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:54:40 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:54:40 user nova-compute[74278]:       <nova:owner>
Oct 30 10:54:40 user nova-compute[74278]:         <nova:user uuid="3d00cea0f58247448d911d841ef601d2">tempest-VolumesAdminNegativeTest-358317095-project-member</nova:user>
Oct 30 10:54:40 user nova-compute[74278]:         <nova:project uuid="02150e63eb6442ecaf9377edc9036949">tempest-VolumesAdminNegativeTest-358317095</nova:project>
Oct 30 10:54:40 user nova-compute[74278]:       </nova:owner>
Oct 30 10:54:40 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:54:40 user nova-compute[74278]:       <nova:ports>
Oct 30 10:54:40 user nova-compute[74278]:         <nova:port uuid="ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f">
Oct 30 10:54:40 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 10:54:40 user nova-compute[74278]:         </nova:port>
Oct 30 10:54:40 user nova-compute[74278]:       </nova:ports>
Oct 30 10:54:40 user nova-compute[74278]:     </nova:instance>
Oct 30 10:54:40 user nova-compute[74278]:   </metadata>
Oct 30 10:54:40 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:54:40 user nova-compute[74278]:     <system>
Oct 30 10:54:40 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:54:40 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:54:40 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:54:40 user nova-compute[74278]:       <entry name="serial">b5d47df1-5569-433d-bf6a-42b5e04196fa</entry>
Oct 30 10:54:40 user nova-compute[74278]:       <entry name="uuid">b5d47df1-5569-433d-bf6a-42b5e04196fa</entry>
Oct 30 10:54:40 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:54:40 user nova-compute[74278]:     </system>
Oct 30 10:54:40 user nova-compute[74278]:   </sysinfo>
Oct 30 10:54:40 user nova-compute[74278]:   <os>
Oct 30 10:54:40 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:54:40 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:54:40 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:54:40 user nova-compute[74278]:   </os>
Oct 30 10:54:40 user nova-compute[74278]:   <features>
Oct 30 10:54:40 user nova-compute[74278]:     <acpi/>
Oct 30 10:54:40 user nova-compute[74278]:     <apic/>
Oct 30 10:54:40 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:54:40 user nova-compute[74278]:   </features>
Oct 30 10:54:40 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:54:40 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:54:40 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:54:40 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:54:40 user nova-compute[74278]:   </clock>
Oct 30 10:54:40 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:54:40 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:54:40 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:54:40 user nova-compute[74278]:   </cpu>
Oct 30 10:54:40 user nova-compute[74278]:   <devices>
Oct 30 10:54:40 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:54:40 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:54:40 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk"/>
Oct 30 10:54:40 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:54:40 user nova-compute[74278]:     </disk>
Oct 30 10:54:40 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:54:40 user nova-compute[74278]:       <mac address="fa:16:3e:f4:b6:68"/>
Oct 30 10:54:40 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:54:40 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:54:40 user nova-compute[74278]:       <target dev="tapddc4c9e5-40"/>
Oct 30 10:54:40 user nova-compute[74278]:     </interface>
Oct 30 10:54:40 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:54:40 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/console.log" append="off"/>
Oct 30 10:54:40 user nova-compute[74278]:     </serial>
Oct 30 10:54:40 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:54:40 user nova-compute[74278]:     <video>
Oct 30 10:54:40 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:54:40 user nova-compute[74278]:     </video>
Oct 30 10:54:40 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:54:40 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:54:40 user nova-compute[74278]:     </rng>
Oct 30 10:54:40 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:54:40 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:54:40 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:54:40 user nova-compute[74278]:     </memballoon>
Oct 30 10:54:40 user nova-compute[74278]:   </devices>
Oct 30 10:54:40 user nova-compute[74278]: </domain>
Oct 30 10:54:40 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-437004539',display_name='tempest-VolumesAdminNegativeTest-server-437004539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-437004539',id=16,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02150e63eb6442ecaf9377edc9036949',ramdisk_id='',reservation_id='r-tyblzwm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-358317095',owner_user_name='tempest-VolumesAdminNegativeTest-358317095-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:54:37Z,user_data=None,user_id='3d00cea0f58247448d911d841ef601d2',uuid=b5d47df1-5569-433d-bf6a-42b5e04196fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "address": "fa:16:3e:f4:b6:68", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc4c9e5-40", "ovs_interfaceid": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Converting VIF {"id": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "address": "fa:16:3e:f4:b6:68", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc4c9e5-40", "ovs_interfaceid": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc4c9e5-40') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_vif [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc4c9e5-40') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4616b352-58d7-58f4-9a07-4d5ed64fdbb9', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapddc4c9e5-40, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapddc4c9e5-40, col_values=(('qos', UUID('491b786f-63f4-4bb3-8114-89c468f8ef06')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapddc4c9e5-40, col_values=(('external_ids', {'iface-id': 'ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:b6:68', 'vm-uuid': 'b5d47df1-5569-433d-bf6a-42b5e04196fa'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e6f64e-2f21-4d73-a81a-20fd699bedf8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:54:40 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:40 user nova-compute[74278]: INFO os_vif [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc4c9e5-40')
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5372fba-f4e5-46c7-9cd8-c5532903f147]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c] added
Oct 30 10:54:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.compute.manager [req-8eb0def9-ff24-43b0-b3d2-f90676c5fa87 req-62a0bbcf-1299-4589-8d2e-b9fd6ddcd796 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Received event network-changed-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.compute.manager [req-8eb0def9-ff24-43b0-b3d2-f90676c5fa87 req-62a0bbcf-1299-4589-8d2e-b9fd6ddcd796 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Refreshing instance network info cache due to event network-changed-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8eb0def9-ff24-43b0-b3d2-f90676c5fa87 req-62a0bbcf-1299-4589-8d2e-b9fd6ddcd796 service nova] Acquiring lock "refresh_cache-b5d47df1-5569-433d-bf6a-42b5e04196fa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8eb0def9-ff24-43b0-b3d2-f90676c5fa87 req-62a0bbcf-1299-4589-8d2e-b9fd6ddcd796 service nova] Acquired lock "refresh_cache-b5d47df1-5569-433d-bf6a-42b5e04196fa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.network.neutron [req-8eb0def9-ff24-43b0-b3d2-f90676c5fa87 req-62a0bbcf-1299-4589-8d2e-b9fd6ddcd796 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Refreshing network info cache for port ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefd954d-bac2-437a-bfbf-214256cbf274]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[49611360-c177-449b-b139-f7e3900b5342]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxUyZTWd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] No VIF found with MAC fa:16:3e:f4:b6:68, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxUyZTWd" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab9a3d1-9a7c-41db-9fac-9d087c266c02]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FxUyZTWd'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d2d4a1-017d-4bc6-940c-282842b22566]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fa4e42-d434-40a5-9708-b7499aca8a3f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef15eec4-d82c-41fc-b053-a7092a7b17bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260]
Oct 30 10:54:40 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260] successful.
Oct 30 10:54:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[762aa90c-f70d-4db9-8532-8d1a444d1d16]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8982b15f-db85-4441-afdf-9a995286a153]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:40 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fed5e61-7bd7-4c15-816c-a59a9c4a55d6]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:54:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxUyZTWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG nova.network.neutron [req-8eb0def9-ff24-43b0-b3d2-f90676c5fa87 req-62a0bbcf-1299-4589-8d2e-b9fd6ddcd796 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Updated VIF entry in instance network info cache for port ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG nova.network.neutron [req-8eb0def9-ff24-43b0-b3d2-f90676c5fa87 req-62a0bbcf-1299-4589-8d2e-b9fd6ddcd796 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Updating instance_info_cache with network_info: [{"id": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "address": "fa:16:3e:f4:b6:68", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc4c9e5-40", "ovs_interfaceid": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8eb0def9-ff24-43b0-b3d2-f90676c5fa87 req-62a0bbcf-1299-4589-8d2e-b9fd6ddcd796 service nova] Releasing lock "refresh_cache-b5d47df1-5569-433d-bf6a-42b5e04196fa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Acquiring lock "d71474f7-0b91-49e5-b03b-56628ae7823e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Acquiring lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:41 user nova-compute[74278]: INFO nova.compute.manager [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Terminating instance
Oct 30 10:54:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26133663466313931', 'path': '/dev/sdg'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133663466313931', 'path': '/dev/sdg'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:41 user nova-compute[74278]: DEBUG nova.objects.instance [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lazy-loading 'flavor' on Instance uuid 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 10:54:42 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:54:42 user nova-compute[74278]:   <source dev="/dev/sdg"/>
Oct 30 10:54:42 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:54:42 user nova-compute[74278]:   <serial>e0066f51-c274-4eea-9f0c-8acdcded086c</serial>
Oct 30 10:54:42 user nova-compute[74278]: </disk>
Oct 30 10:54:42 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-1f449c22-7ea7-4bbb-8aba-6c89d3047fc6 req-f8801031-bb9a-4499-a73a-621f137c934c service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Received event network-vif-unplugged-4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1f449c22-7ea7-4bbb-8aba-6c89d3047fc6 req-f8801031-bb9a-4499-a73a-621f137c934c service nova] Acquiring lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1f449c22-7ea7-4bbb-8aba-6c89d3047fc6 req-f8801031-bb9a-4499-a73a-621f137c934c service nova] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1f449c22-7ea7-4bbb-8aba-6c89d3047fc6 req-f8801031-bb9a-4499-a73a-621f137c934c service nova] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-1f449c22-7ea7-4bbb-8aba-6c89d3047fc6 req-f8801031-bb9a-4499-a73a-621f137c934c service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] No waiting events found dispatching network-vif-unplugged-4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-1f449c22-7ea7-4bbb-8aba-6c89d3047fc6 req-f8801031-bb9a-4499-a73a-621f137c934c service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Received event network-vif-unplugged-4be24152-a25b-4a37-bdc9-93189991dde8 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-153892ef-9b37-431f-a05b-e02112f8b257 req-33d6244a-161d-4091-b1e8-24616d501b64 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Received event network-vif-plugged-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-153892ef-9b37-431f-a05b-e02112f8b257 req-33d6244a-161d-4091-b1e8-24616d501b64 service nova] Acquiring lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-153892ef-9b37-431f-a05b-e02112f8b257 req-33d6244a-161d-4091-b1e8-24616d501b64 service nova] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-153892ef-9b37-431f-a05b-e02112f8b257 req-33d6244a-161d-4091-b1e8-24616d501b64 service nova] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-153892ef-9b37-431f-a05b-e02112f8b257 req-33d6244a-161d-4091-b1e8-24616d501b64 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] No waiting events found dispatching network-vif-plugged-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:42 user nova-compute[74278]: WARNING nova.compute.manager [req-153892ef-9b37-431f-a05b-e02112f8b257 req-33d6244a-161d-4091-b1e8-24616d501b64 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Received unexpected event network-vif-plugged-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f for instance with vm_state building and task_state spawning.
Oct 30 10:54:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:43 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Instance destroyed successfully.
Oct 30 10:54:43 user nova-compute[74278]: DEBUG nova.objects.instance [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lazy-loading 'resources' on Instance uuid d71474f7-0b91-49e5-b03b-56628ae7823e {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:51:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-965192881',display_name='tempest-VolumesAssistedSnapshotsTest-server-965192881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-965192881',id=9,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKJlMZvxXk4JAmeaCcAPCxvG+w0EiJIPbgaVknuhia7ZOpLHtsXajwPTjXQ68UxvMBzeyBWbNOHgU2EdkwHX5Kod5roXgDcjlCgazZvjv4M50n7Ou2o09alvs/SvdFiLA==',key_name='tempest-keypair-1172737879',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:51:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d40f572025eb4a8d98e01945f7375b34',ramdisk_id='',reservation_id='r-gj0ogx7g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1038709422',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1038709422-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:51:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5aba23c914c4fc6971b4abf39e8b6a9',uuid=d71474f7-0b91-49e5-b03b-56628ae7823e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4be24152-a25b-4a37-bdc9-93189991dde8", "address": "fa:16:3e:81:3f:49", "network": {"id": "c6818f86-d1aa-4736-afbc-f516531a4a23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-83968978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40f572025eb4a8d98e01945f7375b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be24152-a2", "ovs_interfaceid": "4be24152-a25b-4a37-bdc9-93189991dde8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Converting VIF {"id": "4be24152-a25b-4a37-bdc9-93189991dde8", "address": "fa:16:3e:81:3f:49", "network": {"id": "c6818f86-d1aa-4736-afbc-f516531a4a23", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-83968978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d40f572025eb4a8d98e01945f7375b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be24152-a2", "ovs_interfaceid": "4be24152-a25b-4a37-bdc9-93189991dde8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=4be24152-a25b-4a37-bdc9-93189991dde8,network=Network(c6818f86-d1aa-4736-afbc-f516531a4a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be24152-a2') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG os_vif [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=4be24152-a25b-4a37-bdc9-93189991dde8,network=Network(c6818f86-d1aa-4736-afbc-f516531a4a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be24152-a2') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4be24152-a2, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd7365c3-39e0-45a3-a0cd-ebc88854794b) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:43 user nova-compute[74278]: INFO os_vif [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:3f:49,bridge_name='br-int',has_traffic_filtering=True,id=4be24152-a25b-4a37-bdc9-93189991dde8,network=Network(c6818f86-d1aa-4736-afbc-f516531a4a23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be24152-a2')
Oct 30 10:54:43 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Deleting instance files /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e_del
Oct 30 10:54:43 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Deletion of /opt/stack/data/nova/instances/d71474f7-0b91-49e5-b03b-56628ae7823e_del complete
Oct 30 10:54:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] No VIF found with MAC fa:16:3e:8b:ee:5f, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:54:43 user nova-compute[74278]: INFO nova.compute.manager [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 30 10:54:43 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed9804f7-24a8-46af-afc5-558ccb8bebc9 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.137s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Received event network-vif-plugged-4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] Acquiring lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] No waiting events found dispatching network-vif-plugged-4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:44 user nova-compute[74278]: WARNING nova.compute.manager [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Received unexpected event network-vif-plugged-4be24152-a25b-4a37-bdc9-93189991dde8 for instance with vm_state active and task_state deleting.
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-changed-edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing instance network info cache due to event network-changed-edff675c-acda-4742-ad07-9d0467793110. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] Acquiring lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] Acquired lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Refreshing network info cache for port edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-769ee99d-371f-4a44-8162-1b24721f02c1 req-56aa35be-1f6f-417e-85ef-1dd504fd53c0 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Received event network-vif-plugged-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-769ee99d-371f-4a44-8162-1b24721f02c1 req-56aa35be-1f6f-417e-85ef-1dd504fd53c0 service nova] Acquiring lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-769ee99d-371f-4a44-8162-1b24721f02c1 req-56aa35be-1f6f-417e-85ef-1dd504fd53c0 service nova] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-769ee99d-371f-4a44-8162-1b24721f02c1 req-56aa35be-1f6f-417e-85ef-1dd504fd53c0 service nova] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-769ee99d-371f-4a44-8162-1b24721f02c1 req-56aa35be-1f6f-417e-85ef-1dd504fd53c0 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] No waiting events found dispatching network-vif-plugged-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:44 user nova-compute[74278]: WARNING nova.compute.manager [req-769ee99d-371f-4a44-8162-1b24721f02c1 req-56aa35be-1f6f-417e-85ef-1dd504fd53c0 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Received unexpected event network-vif-plugged-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f for instance with vm_state building and task_state spawning.
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:44 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Took 1.65 seconds to deallocate network for instance.
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-eb65afbd-0218-4c25-b094-c39f10c5dc26 req-16a8481c-102a-410f-858a-d02a6855099f service nova] [instance: d71474f7-0b91-49e5-b03b-56628ae7823e] Received event network-vif-deleted-4be24152-a25b-4a37-bdc9-93189991dde8 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updated VIF entry in instance network info cache for port edff675c-acda-4742-ad07-9d0467793110. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [{"id": "edff675c-acda-4742-ad07-9d0467793110", "address": "fa:16:3e:b3:fb:38", "network": {"id": "19ff6d4c-75b3-458e-b3de-078a13b43272", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-53728059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff675c-ac", "ovs_interfaceid": "edff675c-acda-4742-ad07-9d0467793110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1b06f976-91fc-493b-bde5-2bfc4e0b36cb req-c8fd0578-6a2c-48ed-a648-9660aa526322 service nova] Releasing lock "refresh_cache-3c26a595-b269-44b0-bf02-43b6b768183e" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:54:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:54:45 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Instance spawned successfully.
Oct 30 10:54:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:54:45 user nova-compute[74278]: INFO nova.compute.manager [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Took 7.53 seconds to spawn the instance on the hypervisor.
Oct 30 10:54:45 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:54:45 user nova-compute[74278]: INFO nova.compute.manager [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Took 8.76 seconds to build instance.
Oct 30 10:54:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1e95a381-9bfe-4913-a184-0489fddeaf77 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.984s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:45 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Deleted allocations for instance d71474f7-0b91-49e5-b03b-56628ae7823e
Oct 30 10:54:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-776507d7-9370-4400-9a3c-ce27a6eda284 tempest-VolumesAssistedSnapshotsTest-1038709422 tempest-VolumesAssistedSnapshotsTest-1038709422-project-member] Lock "d71474f7-0b91-49e5-b03b-56628ae7823e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.667s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Stashing vm_state: active {{(pid=74278) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:45 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:54:45 user nova-compute[74278]: INFO nova.compute.claims [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Claim successful on node user
Oct 30 10:54:45 user nova-compute[74278]: INFO nova.compute.resource_tracker [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating resource usage from migration 8227d4a9-05b8-4c9a-8e51-bdff91fa8bdf
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "3c26a595-b269-44b0-bf02-43b6b768183e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:46 user nova-compute[74278]: INFO nova.compute.manager [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Terminating instance
Oct 30 10:54:46 user nova-compute[74278]: DEBUG nova.compute.manager [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-d3b26327-458c-4d60-a115-7b139151bb9c req-71896d53-de10-427a-bf21-44b8ac70fc01 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d3b26327-458c-4d60-a115-7b139151bb9c req-71896d53-de10-427a-bf21-44b8ac70fc01 service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d3b26327-458c-4d60-a115-7b139151bb9c req-71896d53-de10-427a-bf21-44b8ac70fc01 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d3b26327-458c-4d60-a115-7b139151bb9c req-71896d53-de10-427a-bf21-44b8ac70fc01 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-d3b26327-458c-4d60-a115-7b139151bb9c req-71896d53-de10-427a-bf21-44b8ac70fc01 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-unplugged-edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-d3b26327-458c-4d60-a115-7b139151bb9c req-71896d53-de10-427a-bf21-44b8ac70fc01 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-edff675c-acda-4742-ad07-9d0467793110 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.632s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:46 user nova-compute[74278]: INFO nova.compute.manager [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Migrating
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:54:46 user nova-compute[74278]: INFO nova.compute.rpcapi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquired lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-2892aca1-b4c0-44e8-86f5-b24e954dbe40 req-5445c304-88c8-40ef-b51f-2cc95fce3459 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2892aca1-b4c0-44e8-86f5-b24e954dbe40 req-5445c304-88c8-40ef-b51f-2cc95fce3459 service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2892aca1-b4c0-44e8-86f5-b24e954dbe40 req-5445c304-88c8-40ef-b51f-2cc95fce3459 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2892aca1-b4c0-44e8-86f5-b24e954dbe40 req-5445c304-88c8-40ef-b51f-2cc95fce3459 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-2892aca1-b4c0-44e8-86f5-b24e954dbe40 req-5445c304-88c8-40ef-b51f-2cc95fce3459 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-unplugged-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-2892aca1-b4c0-44e8-86f5-b24e954dbe40 req-5445c304-88c8-40ef-b51f-2cc95fce3459 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:54:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:47 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating instance_info_cache with network_info: [{"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Releasing lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:54:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Instance destroyed successfully.
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.objects.instance [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lazy-loading 'resources' on Instance uuid 3c26a595-b269-44b0-bf02-43b6b768183e {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:53:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edff675c-acda-4742-ad07-9d0467793110", "address": "fa:16:3e:b3:fb:38", "network": {"id": "19ff6d4c-75b3-458e-b3de-078a13b43272", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-53728059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff675c-ac", "ovs_interfaceid": "edff675c-acda-4742-ad07-9d0467793110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "edff675c-acda-4742-ad07-9d0467793110", "address": "fa:16:3e:b3:fb:38", "network": {"id": "19ff6d4c-75b3-458e-b3de-078a13b43272", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-53728059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedff675c-ac", "ovs_interfaceid": "edff675c-acda-4742-ad07-9d0467793110", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:fb:38,bridge_name='br-int',has_traffic_filtering=True,id=edff675c-acda-4742-ad07-9d0467793110,network=Network(19ff6d4c-75b3-458e-b3de-078a13b43272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff675c-ac') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:fb:38,bridge_name='br-int',has_traffic_filtering=True,id=edff675c-acda-4742-ad07-9d0467793110,network=Network(19ff6d4c-75b3-458e-b3de-078a13b43272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff675c-ac') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedff675c-ac, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30a6809e-729e-4be4-a16c-2f9fa472f752) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Starting migrate_disk_and_power_off {{(pid=74278) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: INFO os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:fb:38,bridge_name='br-int',has_traffic_filtering=True,id=edff675c-acda-4742-ad07-9d0467793110,network=Network(19ff6d4c-75b3-458e-b3de-078a13b43272),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedff675c-ac')
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:53:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:4a:9e,bridge_name='br-int',has_traffic_filtering=True,id=04dc9645-4e3f-4ea7-9f9f-67d4b1df3688,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04dc9645-4e') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:4a:9e,bridge_name='br-int',has_traffic_filtering=True,id=04dc9645-4e3f-4ea7-9f9f-67d4b1df3688,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04dc9645-4e') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04dc9645-4e, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=516511e0-4c20-4852-aa77-ae22f176ff82) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:48 user nova-compute[74278]: WARNING nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-edff675c-acda-4742-ad07-9d0467793110 for instance with vm_state active and task_state deleting.
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-f86eed54-e62f-496b-9a5f-ed15fb77dd3c {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-unplugged-f86eed54-e62f-496b-9a5f-ed15fb77dd3c {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-f86eed54-e62f-496b-9a5f-ed15fb77dd3c for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-f86eed54-e62f-496b-9a5f-ed15fb77dd3c {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-f86eed54-e62f-496b-9a5f-ed15fb77dd3c {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:48 user nova-compute[74278]: WARNING nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-f86eed54-e62f-496b-9a5f-ed15fb77dd3c for instance with vm_state active and task_state deleting.
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-unplugged-64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-64a18b70-db46-4f6e-825f-402681eca643 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:48 user nova-compute[74278]: WARNING nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-64a18b70-db46-4f6e-825f-402681eca643 for instance with vm_state active and task_state deleting.
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-unplugged-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-7cfe6629-9cc4-4ad6-98e8-07f9f40d04c4 req-d7858c5c-3fb5-41cc-83a3-7501e03156fa service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: INFO os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:4a:9e,bridge_name='br-int',has_traffic_filtering=True,id=04dc9645-4e3f-4ea7-9f9f-67d4b1df3688,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap04dc9645-4e')
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:53:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:37:63,bridge_name='br-int',has_traffic_filtering=True,id=f86eed54-e62f-496b-9a5f-ed15fb77dd3c,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf86eed54-e6') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:37:63,bridge_name='br-int',has_traffic_filtering=True,id=f86eed54-e62f-496b-9a5f-ed15fb77dd3c,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf86eed54-e6') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf86eed54-e6, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c18415c-899c-49be-aa9d-62a799be6ee4) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: INFO os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:37:63,bridge_name='br-int',has_traffic_filtering=True,id=f86eed54-e62f-496b-9a5f-ed15fb77dd3c,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf86eed54-e6')
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:53:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8b:ad,bridge_name='br-int',has_traffic_filtering=True,id=64a18b70-db46-4f6e-825f-402681eca643,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a18b70-db') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8b:ad,bridge_name='br-int',has_traffic_filtering=True,id=64a18b70-db46-4f6e-825f-402681eca643,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a18b70-db') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64a18b70-db, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=770b500a-daca-4f6c-a0fa-3edcb49ffc35) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: INFO os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:8b:ad,bridge_name='br-int',has_traffic_filtering=True,id=64a18b70-db46-4f6e-825f-402681eca643,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64a18b70-db')
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:53:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:22:22,bridge_name='br-int',has_traffic_filtering=True,id=67ab7040-7f2b-4b2f-acb6-afa9d70c94ff,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab7040-7f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:22:22,bridge_name='br-int',has_traffic_filtering=True,id=67ab7040-7f2b-4b2f-acb6-afa9d70c94ff,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab7040-7f') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67ab7040-7f, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:49 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Instance destroyed successfully.
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1697547587',display_name='tempest-ServerActionsTestOtherB-server-1697547587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1697547587',id=4,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxtrS9IHVw9VJCYjUF6eDWBKHwb7bFWD3A669NQggiEpEfM7XQnDLYLkziVDxGhK2ctlm9Mx1VSfhVfRehAdJNYHfhfvjHZCeNc+QL1vrbZckvK1AnRE3E7SPpnRLWh5Q==',key_name='tempest-keypair-979570287',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:50:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a59c309805c1416793e76777407ef388',ramdisk_id='',reservation_id='r-f0ytqg1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1708015848',owner_user_name='tempest-ServerActionsTestOtherB-1708015848-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:54:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7002e346bd664217af927725af208c54',uuid=25c5ad55-f85b-4371-8bdf-95a6a0f4d73d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-339457430-network", "vif_mac": "fa:16:3e:8b:ee:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converting VIF {"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-339457430-network", "vif_mac": "fa:16:3e:8b:ee:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_vif [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap346d37bb-47, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:49 user nova-compute[74278]: WARNING nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-04dc9645-4e3f-4ea7-9f9f-67d4b1df3688 for instance with vm_state active and task_state deleting.
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-unplugged-65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-65829325-bf17-46c2-b8b3-8eba21130ce1 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:49 user nova-compute[74278]: WARNING nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-65829325-bf17-46c2-b8b3-8eba21130ce1 for instance with vm_state active and task_state deleting.
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-unplugged-c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-unplugged-c65bf1e5-c95f-473e-9452-fc6ff873d709 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:49 user nova-compute[74278]: WARNING nova.compute.manager [req-8ff10cbf-764f-4a2e-ac34-629e5ea85307 req-09a92a45-1394-4817-afe5-d255734edb46 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-c65bf1e5-c95f-473e-9452-fc6ff873d709 for instance with vm_state active and task_state deleting.
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d63c8baf-6663-4780-b551-04a56a0f4b6d) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d98db29-184b-493e-a433-65ba17e55615) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:49 user nova-compute[74278]: INFO os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:22:22,bridge_name='br-int',has_traffic_filtering=True,id=67ab7040-7f2b-4b2f-acb6-afa9d70c94ff,network=Network(dc90c5e6-371d-41c7-9a16-377b48ccffda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab7040-7f')
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:53:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:ba,bridge_name='br-int',has_traffic_filtering=True,id=65829325-bf17-46c2-b8b3-8eba21130ce1,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65829325-bf') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:ba,bridge_name='br-int',has_traffic_filtering=True,id=65829325-bf17-46c2-b8b3-8eba21130ce1,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65829325-bf') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65829325-bf, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:49 user nova-compute[74278]: INFO os_vif [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47')
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxUyZTWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:54:49 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb210759-0644-46bd-9205-bc7dec3252ff) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: INFO os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:db:ba,bridge_name='br-int',has_traffic_filtering=True,id=65829325-bf17-46c2-b8b3-8eba21130ce1,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65829325-bf')
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-236877004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-236877004',id=10,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZayU1B59xjmJCn05FJit224d1gHtVdFkc6arGd5bofQvP1JtOwHljf81bxcgVdNf8hR0cC/+Xx5YUf94F+cahjvgQK7xWMcCmhHWiUIgaILP/niLWHFfKwatOOkpDcGA==',key_name='tempest-keypair-2080736860',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:53:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ede4e1a736e44d34b20ff87b3080c98f',ramdisk_id='',reservation_id='r-0jh0t28h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1464307696',owner_user_name='tempest-TaggedBootDevicesTest-1464307696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca01d5bb5fed4d10a71dc75a9b84cce5',uuid=3c26a595-b269-44b0-bf02-43b6b768183e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converting VIF {"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:25,bridge_name='br-int',has_traffic_filtering=True,id=c65bf1e5-c95f-473e-9452-fc6ff873d709,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc65bf1e5-c9') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:25,bridge_name='br-int',has_traffic_filtering=True,id=c65bf1e5-c95f-473e-9452-fc6ff873d709,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc65bf1e5-c9') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc65bf1e5-c9, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc525db-0452-48b0-8bb7-82eb4d415f00]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:54:49 user nova-compute[74278]: No targets found.
Oct 30 10:54:49 user nova-compute[74278]: iSNS:
Oct 30 10:54:49 user nova-compute[74278]: No targets found.
Oct 30 10:54:49 user nova-compute[74278]: STATIC:
Oct 30 10:54:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c
Oct 30 10:54:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db
Oct 30 10:54:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3
Oct 30 10:54:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:54:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6
Oct 30 10:54:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47
Oct 30 10:54:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:49 user nova-compute[74278]: FIRMWARE:
Oct 30 10:54:49 user nova-compute[74278]: No targets found.
Oct 30 10:54:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:54:49 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:54:49 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95024141-0af8-40d1-b378-262fac83318d) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:54:49 user nova-compute[74278]: INFO os_vif [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:25,bridge_name='br-int',has_traffic_filtering=True,id=c65bf1e5-c95f-473e-9452-fc6ff873d709,network=Network(11498da1-cbcf-4055-b368-f4d2add5d13b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc65bf1e5-c9')
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hlnMTHKe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:54:49 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[816b8d8e-8995-48e1-8bc2-82771cdde5d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f3e3a6-673c-41d0-b881-5eaec03144b1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c4a6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c'): ({'sdg'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Removing single pathed devices sdg {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aa39ed-e857-441e-bb35-19113c05e2f4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4cd6b9-dbcf-4a5a-997a-91dc2caad6e9]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Flushing IO for device /dev/sdg {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5d4b9f-bfec-4999-a675-0e708148a9bb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db73be-e49b-4191-b86c-b6a5fba62bb0]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] SCSI volumes sdg have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdec4b7-5b3a-4140-a391-b0f9bccd2bec]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[495aa29d-0b01-4db3-8ee2-e975e9a290a0]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260]
Oct 30 10:54:49 user nova-compute[74278]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260] successful.
Oct 30 10:54:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6ab0b0-f5ae-4ef8-b051-09c648a64234]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] <== disconnect_volume: return (385ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.318s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b688d7-b4f1-4caa-b5fe-cd734d24c90a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:54:49 user nova-compute[74278]: No targets found.
Oct 30 10:54:49 user nova-compute[74278]: iSNS:
Oct 30 10:54:49 user nova-compute[74278]: No targets found.
Oct 30 10:54:49 user nova-compute[74278]: STATIC:
Oct 30 10:54:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db
Oct 30 10:54:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3
Oct 30 10:54:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:54:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6
Oct 30 10:54:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47
Oct 30 10:54:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:49 user nova-compute[74278]: FIRMWARE:
Oct 30 10:54:49 user nova-compute[74278]: No targets found.
Oct 30 10:54:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:54:49 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:54:49 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8999a9e-f098-444e-848f-b48c5cf73dd4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[831cb68a-c463-45a6-b097-b2207d3d9220]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:49 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c599090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd39688-0165-49f2-8288-2e2913146538]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d234942-b7b4-4151-97b5-0a69600a141c]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2695547-a3ef-412d-be00-7a6fc0f61ea1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[29227e73-fbda-4d72-abca-5f74a059ce3d]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8ba678-246f-41a4-9ea7-8d826d683200]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[705a3ebd-6fc8-47de-a768-c56e0bff1092]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47, portal: 172.16.0.220,3260]
Oct 30 10:54:49 user nova-compute[74278]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47, portal: 172.16.0.220,3260] successful.
Oct 30 10:54:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:54:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d_resize/disk /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3b4bf1cf-571a-47d2-b86c-75e5e4210b47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd39981-7098-46ab-aacf-b0d470a6c2d9]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] <== disconnect_volume: return (753ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KNBCmvGR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:54:50 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8d81e5-0e97-4027-898a-d8a5d2863215]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:54:50 user nova-compute[74278]: No targets found.
Oct 30 10:54:50 user nova-compute[74278]: iSNS:
Oct 30 10:54:50 user nova-compute[74278]: No targets found.
Oct 30 10:54:50 user nova-compute[74278]: STATIC:
Oct 30 10:54:50 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db
Oct 30 10:54:50 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:50 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:50 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3
Oct 30 10:54:50 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:50 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:50 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:54:50 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:50 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:50 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6
Oct 30 10:54:50 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:50 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:50 user nova-compute[74278]: FIRMWARE:
Oct 30 10:54:50 user nova-compute[74278]: No targets found.
Oct 30 10:54:50 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:54:50 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:54:50 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f1da79-a231-474b-8387-c9068533ad93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2490e9b5-95d9-4c8e-b489-e87020926b5d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:50 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:50 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:50 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:50 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:50 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:50 user nova-compute[74278]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 (non-flash)
Oct 30 10:54:50 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:50 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c599090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3'): ({'sdd'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Removing single pathed devices sdd {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc5e369-8c2d-498c-bb03-8dfadaeaf5fa]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aaba3e-f771-492d-927c-b4d69b8da399]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Flushing IO for device /dev/sdd {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f79e7b-fa5b-40f1-a3d3-ca4d5735391a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f877ca7-4ea3-44ab-90e4-3330e4068578]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4e4387-5354-4d1a-bf6d-b63bbc01968d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f39b13d-8d54-4fde-bb6f-7db9c9fce174]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3, portal: 172.16.0.220,3260]
Oct 30 10:54:50 user nova-compute[74278]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3, portal: 172.16.0.220,3260] successful.
Oct 30 10:54:50 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e841c31-e573-410b-b282-1810a83a99e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6b5925-fd5c-4b91-a6cb-572afa87e844]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] <== disconnect_volume: return (367ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYUaRKGo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:54:50 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10979f1-aaad-4626-b3fe-132db10b3cf3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:54:50 user nova-compute[74278]: No targets found.
Oct 30 10:54:50 user nova-compute[74278]: iSNS:
Oct 30 10:54:50 user nova-compute[74278]: No targets found.
Oct 30 10:54:50 user nova-compute[74278]: STATIC:
Oct 30 10:54:50 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db
Oct 30 10:54:50 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:50 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:50 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:54:50 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:50 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:50 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6
Oct 30 10:54:50 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:54:50 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:54:50 user nova-compute[74278]: FIRMWARE:
Oct 30 10:54:50 user nova-compute[74278]: No targets found.
Oct 30 10:54:50 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:54:50 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:54:50 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c2ad8a-f22d-4d65-9c49-0094a193b374]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CMD "cp -r /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d_resize/disk /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk" returned: 0 in 0.513s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d_resize/disk.info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk.info {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4ace98-64e5-41bf-bda7-b476e46269b2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:50 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:50 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:50 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:54:50 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:54:50 user nova-compute[74278]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db (non-flash)
Oct 30 10:54:50 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c599090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db'): ({'sde'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Removing single pathed devices sde {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CMD "cp -r /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d_resize/disk.info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk.info" returned: 0 in 0.048s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98dca2e-d801-4844-b5a7-359b8f175fe1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7be61a9-0a2c-4c54-85c7-a63518fc3198]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Flushing IO for device /dev/sde {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fc4e15-6f8b-4eba-aa99-d8c586b1180f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[611f96e8-340a-4095-bcc1-d0652ddd3f1d]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] SCSI volumes sde have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-plugged-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] Acquiring lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] Lock "3c26a595-b269-44b0-bf02-43b6b768183e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] No waiting events found dispatching network-vif-plugged-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:50 user nova-compute[74278]: WARNING nova.compute.manager [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received unexpected event network-vif-plugged-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff for instance with vm_state active and task_state deleting.
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-unplugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] No waiting events found dispatching network-vif-unplugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:50 user nova-compute[74278]: WARNING nova.compute.manager [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received unexpected event network-vif-unplugged-346d37bb-4749-43ab-b83e-c0472def78b2 for instance with vm_state active and task_state resize_migrating.
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] No waiting events found dispatching network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:54:50 user nova-compute[74278]: WARNING nova.compute.manager [req-ae7ae06f-2451-4df7-a5cc-6c6389b54374 req-7282866a-8a6a-496a-af5d-ffd36953343a service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received unexpected event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 for instance with vm_state active and task_state resize_migrating.
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[444fb1b9-ee83-457d-96a0-49f661850289]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1700cdbe-5d54-4862-8453-76e5f03f26e5]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db, portal: 172.16.0.220,3260]
Oct 30 10:54:50 user nova-compute[74278]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db, portal: 172.16.0.220,3260] successful.
Oct 30 10:54:50 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:352a4886-2b5c-478c-bddb-47be3ae313db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1331ce6b-c8f2-445f-81ab-f0d836f1619b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] <== disconnect_volume: return (407ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:54:50 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Deleting instance files /opt/stack/data/nova/instances/3c26a595-b269-44b0-bf02-43b6b768183e_del
Oct 30 10:54:50 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Deletion of /opt/stack/data/nova/instances/3c26a595-b269-44b0-bf02-43b6b768183e_del complete
Oct 30 10:54:50 user nova-compute[74278]: INFO nova.compute.manager [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Took 4.84 seconds to destroy the instance on the hypervisor.
Oct 30 10:54:50 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:54:50 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:54:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:52 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Port 346d37bb-4749-43ab-b83e-c0472def78b2 binding to destination host user is already ACTIVE {{(pid=74278) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 30 10:54:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:54:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:54:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:54:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:54:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquired lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:54:52 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating instance_info_cache with network_info: [{"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Releasing lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG os_brick.utils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0069269-ce1a-4f53-88a9-0105d477074d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efb504a-0a2f-46e1-85cd-926232808954]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56eeaf4-c6bb-40ff-bb71-77a83a1829a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b8f4e6-628d-4ccd-b11e-3d6dfb552ac0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:54:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:54:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:54:54 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:54:54 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b43fcf-4779-4dc6-9fe1-44de24683a2b]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:54:54 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:54:54 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:54:54 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:54:54 user nova-compute[74278]: DEBUG os_brick.utils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:54:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-10c94a07-e211-453f-bdba-c1e7b3d8b666 req-cd8d698e-e4dd-497b-8cbd-2fcd7cbd777d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-deleted-edff675c-acda-4742-ad07-9d0467793110 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:55 user nova-compute[74278]: INFO nova.compute.manager [req-10c94a07-e211-453f-bdba-c1e7b3d8b666 req-cd8d698e-e4dd-497b-8cbd-2fcd7cbd777d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Neutron deleted interface edff675c-acda-4742-ad07-9d0467793110; detaching it from the instance and deleting it from the info cache
Oct 30 10:54:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-10c94a07-e211-453f-bdba-c1e7b3d8b666 req-cd8d698e-e4dd-497b-8cbd-2fcd7cbd777d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [{"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "address": "fa:16:3e:04:22:22", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab7040-7f", "ovs_interfaceid": "67ab7040-7f2b-4b2f-acb6-afa9d70c94ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-10c94a07-e211-453f-bdba-c1e7b3d8b666 req-cd8d698e-e4dd-497b-8cbd-2fcd7cbd777d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Detach interface failed, port_id=edff675c-acda-4742-ad07-9d0467793110, reason: Instance 3c26a595-b269-44b0-bf02-43b6b768183e could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 10:54:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-366a581c-24b3-42a3-9bdc-eeaa41b89ac9 req-91efb315-fbed-454e-b1b5-4de9e2bf7f3d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-deleted-67ab7040-7f2b-4b2f-acb6-afa9d70c94ff {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:57 user nova-compute[74278]: INFO nova.compute.manager [req-366a581c-24b3-42a3-9bdc-eeaa41b89ac9 req-91efb315-fbed-454e-b1b5-4de9e2bf7f3d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Neutron deleted interface 67ab7040-7f2b-4b2f-acb6-afa9d70c94ff; detaching it from the instance and deleting it from the info cache
Oct 30 10:54:57 user nova-compute[74278]: DEBUG nova.network.neutron [req-366a581c-24b3-42a3-9bdc-eeaa41b89ac9 req-91efb315-fbed-454e-b1b5-4de9e2bf7f3d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [{"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65829325-bf17-46c2-b8b3-8eba21130ce1", "address": "fa:16:3e:14:db:ba", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65829325-bf", "ovs_interfaceid": "65829325-bf17-46c2-b8b3-8eba21130ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-366a581c-24b3-42a3-9bdc-eeaa41b89ac9 req-91efb315-fbed-454e-b1b5-4de9e2bf7f3d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Detach interface failed, port_id=67ab7040-7f2b-4b2f-acb6-afa9d70c94ff, reason: Instance 3c26a595-b269-44b0-bf02-43b6b768183e could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 10:54:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-366a581c-24b3-42a3-9bdc-eeaa41b89ac9 req-91efb315-fbed-454e-b1b5-4de9e2bf7f3d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-deleted-65829325-bf17-46c2-b8b3-8eba21130ce1 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:57 user nova-compute[74278]: INFO nova.compute.manager [req-366a581c-24b3-42a3-9bdc-eeaa41b89ac9 req-91efb315-fbed-454e-b1b5-4de9e2bf7f3d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Neutron deleted interface 65829325-bf17-46c2-b8b3-8eba21130ce1; detaching it from the instance and deleting it from the info cache
Oct 30 10:54:57 user nova-compute[74278]: DEBUG nova.network.neutron [req-366a581c-24b3-42a3-9bdc-eeaa41b89ac9 req-91efb315-fbed-454e-b1b5-4de9e2bf7f3d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [{"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "address": "fa:16:3e:c5:a5:25", "network": {"id": "11498da1-cbcf-4055-b368-f4d2add5d13b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1965832855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc65bf1e5-c9", "ovs_interfaceid": "c65bf1e5-c95f-473e-9452-fc6ff873d709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-366a581c-24b3-42a3-9bdc-eeaa41b89ac9 req-91efb315-fbed-454e-b1b5-4de9e2bf7f3d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Detach interface failed, port_id=65829325-bf17-46c2-b8b3-8eba21130ce1, reason: Instance 3c26a595-b269-44b0-bf02-43b6b768183e could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 10:54:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-366a581c-24b3-42a3-9bdc-eeaa41b89ac9 req-91efb315-fbed-454e-b1b5-4de9e2bf7f3d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-deleted-c65bf1e5-c95f-473e-9452-fc6ff873d709 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:54:57 user nova-compute[74278]: INFO nova.compute.manager [req-366a581c-24b3-42a3-9bdc-eeaa41b89ac9 req-91efb315-fbed-454e-b1b5-4de9e2bf7f3d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Neutron deleted interface c65bf1e5-c95f-473e-9452-fc6ff873d709; detaching it from the instance and deleting it from the info cache
Oct 30 10:54:57 user nova-compute[74278]: DEBUG nova.network.neutron [req-366a581c-24b3-42a3-9bdc-eeaa41b89ac9 req-91efb315-fbed-454e-b1b5-4de9e2bf7f3d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [{"id": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "address": "fa:16:3e:19:4a:9e", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04dc9645-4e", "ovs_interfaceid": "04dc9645-4e3f-4ea7-9f9f-67d4b1df3688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "address": "fa:16:3e:ea:37:63", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf86eed54-e6", "ovs_interfaceid": "f86eed54-e62f-496b-9a5f-ed15fb77dd3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64a18b70-db46-4f6e-825f-402681eca643", "address": "fa:16:3e:e1:8b:ad", "network": {"id": "dc90c5e6-371d-41c7-9a16-377b48ccffda", "bridge": "br-int", "label": "tempest-device-tagging-net1-1818158433", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.238", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ede4e1a736e44d34b20ff87b3080c98f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64a18b70-db", "ovs_interfaceid": "64a18b70-db46-4f6e-825f-402681eca643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-366a581c-24b3-42a3-9bdc-eeaa41b89ac9 req-91efb315-fbed-454e-b1b5-4de9e2bf7f3d service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Detach interface failed, port_id=c65bf1e5-c95f-473e-9452-fc6ff873d709, reason: Instance 3c26a595-b269-44b0-bf02-43b6b768183e could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 10:54:57 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:54:57 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Took 6.97 seconds to deallocate network for instance.
Oct 30 10:54:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:54:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-77a2d87e-7cc2-4180-8bc3-42b44b8c43c6 req-722b3e74-1794-431f-b55a-f90c40bb0d73 service nova] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Received event network-vif-deleted-64a18b70-db46-4f6e-825f-402681eca643 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:55:00 user nova-compute[74278]: INFO nova.compute.manager [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] [instance: 3c26a595-b269-44b0-bf02-43b6b768183e] Took 3.04 seconds to detach 3 volumes for instance.
Oct 30 10:55:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:01 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:55:01 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:55:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:01 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Deleted allocations for instance 3c26a595-b269-44b0-bf02-43b6b768183e
Oct 30 10:55:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-580f34bc-ba9b-4a07-bed7-5c50eb0ec91c tempest-TaggedBootDevicesTest-1464307696 tempest-TaggedBootDevicesTest-1464307696-project-member] Lock "3c26a595-b269-44b0-bf02-43b6b768183e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.520s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG nova.compute.manager [req-7b57f7bc-45e4-4290-b6d6-fea778ee6d25 req-1695046d-d1c1-49a2-8b75-ae849c949ce1 service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Received event network-changed-982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG nova.compute.manager [req-7b57f7bc-45e4-4290-b6d6-fea778ee6d25 req-1695046d-d1c1-49a2-8b75-ae849c949ce1 service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Refreshing instance network info cache due to event network-changed-982a753c-a6ca-4884-b3ac-9f6769b439cd. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7b57f7bc-45e4-4290-b6d6-fea778ee6d25 req-1695046d-d1c1-49a2-8b75-ae849c949ce1 service nova] Acquiring lock "refresh_cache-9b6f739d-461c-48a4-a4a7-5eebbca38913" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7b57f7bc-45e4-4290-b6d6-fea778ee6d25 req-1695046d-d1c1-49a2-8b75-ae849c949ce1 service nova] Acquired lock "refresh_cache-9b6f739d-461c-48a4-a4a7-5eebbca38913" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG nova.network.neutron [req-7b57f7bc-45e4-4290-b6d6-fea778ee6d25 req-1695046d-d1c1-49a2-8b75-ae849c949ce1 service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Refreshing network info cache for port 982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG nova.network.neutron [req-7b57f7bc-45e4-4290-b6d6-fea778ee6d25 req-1695046d-d1c1-49a2-8b75-ae849c949ce1 service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Updated VIF entry in instance network info cache for port 982a753c-a6ca-4884-b3ac-9f6769b439cd. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG nova.network.neutron [req-7b57f7bc-45e4-4290-b6d6-fea778ee6d25 req-1695046d-d1c1-49a2-8b75-ae849c949ce1 service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Updating instance_info_cache with network_info: [{"id": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "address": "fa:16:3e:a3:cf:76", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982a753c-a6", "ovs_interfaceid": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "9b6f739d-461c-48a4-a4a7-5eebbca38913" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7b57f7bc-45e4-4290-b6d6-fea778ee6d25 req-1695046d-d1c1-49a2-8b75-ae849c949ce1 service nova] Releasing lock "refresh_cache-9b6f739d-461c-48a4-a4a7-5eebbca38913" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:55:03 user nova-compute[74278]: INFO nova.compute.manager [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Terminating instance
Oct 30 10:55:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-4e048b6c-d270-4bf0-b624-837584dc8df9 req-037b031d-16ba-494c-9d6e-79759ddd99e0 service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Received event network-vif-unplugged-982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4e048b6c-d270-4bf0-b624-837584dc8df9 req-037b031d-16ba-494c-9d6e-79759ddd99e0 service nova] Acquiring lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4e048b6c-d270-4bf0-b624-837584dc8df9 req-037b031d-16ba-494c-9d6e-79759ddd99e0 service nova] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4e048b6c-d270-4bf0-b624-837584dc8df9 req-037b031d-16ba-494c-9d6e-79759ddd99e0 service nova] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-4e048b6c-d270-4bf0-b624-837584dc8df9 req-037b031d-16ba-494c-9d6e-79759ddd99e0 service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] No waiting events found dispatching network-vif-unplugged-982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-4e048b6c-d270-4bf0-b624-837584dc8df9 req-037b031d-16ba-494c-9d6e-79759ddd99e0 service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Received event network-vif-unplugged-982a753c-a6ca-4884-b3ac-9f6769b439cd for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Instance destroyed successfully.
Oct 30 10:55:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'resources' on Instance uuid 9b6f739d-461c-48a4-a4a7-5eebbca38913 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1698872011',display_name='tempest-AttachVolumeNegativeTest-server-1698872011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1698872011',id=12,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZVtk53JwaPS4EIOyoVQ4n/bA3xAPmJaHS0gcNvltHjytUPlVScP3tZhAkvZUyXydAUyN7jkAoNB2dBxmHjnuoSo1FRRnmc90BBpmgh98oOpFyyK14YE+N6L+J5DJO60A==',key_name='tempest-keypair-912609621',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:53:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b43bf73deda348f08290daf640768705',ramdisk_id='',reservation_id='r-5352n706',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-871157650',owner_user_name='tempest-AttachVolumeNegativeTest-871157650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31e7e6847ec0415fba0fd909c014e802',uuid=9b6f739d-461c-48a4-a4a7-5eebbca38913,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "address": "fa:16:3e:a3:cf:76", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982a753c-a6", "ovs_interfaceid": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converting VIF {"id": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "address": "fa:16:3e:a3:cf:76", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982a753c-a6", "ovs_interfaceid": "982a753c-a6ca-4884-b3ac-9f6769b439cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:cf:76,bridge_name='br-int',has_traffic_filtering=True,id=982a753c-a6ca-4884-b3ac-9f6769b439cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982a753c-a6') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG os_vif [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:cf:76,bridge_name='br-int',has_traffic_filtering=True,id=982a753c-a6ca-4884-b3ac-9f6769b439cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982a753c-a6') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap982a753c-a6, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6921ddc2-b68c-45eb-89a8-2457474af39c) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:04 user nova-compute[74278]: INFO os_vif [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:cf:76,bridge_name='br-int',has_traffic_filtering=True,id=982a753c-a6ca-4884-b3ac-9f6769b439cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982a753c-a6')
Oct 30 10:55:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Deleting instance files /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913_del
Oct 30 10:55:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Deletion of /opt/stack/data/nova/instances/9b6f739d-461c-48a4-a4a7-5eebbca38913_del complete
Oct 30 10:55:04 user nova-compute[74278]: INFO nova.compute.manager [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 30 10:55:04 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:55:04 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:55:05 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:55:05 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Took 0.84 seconds to deallocate network for instance.
Oct 30 10:55:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-f0561fa2-08b7-4db1-adfb-959fb2f69867 req-8ebef5e8-7b84-4058-b8ef-61d0bb1a682e service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Received event network-vif-deleted-982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:55:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:05 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:55:05 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:55:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:05 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Deleted allocations for instance 9b6f739d-461c-48a4-a4a7-5eebbca38913
Oct 30 10:55:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d7d3f96b-6a4e-4c24-b773-5d985a27c33e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.089s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-28d368ed-2d57-4bbd-b4f1-06fb4451b0e1 req-3f1d0730-1c45-4c89-82f9-fc7c78d8eea0 service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Received event network-vif-plugged-982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:55:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-28d368ed-2d57-4bbd-b4f1-06fb4451b0e1 req-3f1d0730-1c45-4c89-82f9-fc7c78d8eea0 service nova] Acquiring lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-28d368ed-2d57-4bbd-b4f1-06fb4451b0e1 req-3f1d0730-1c45-4c89-82f9-fc7c78d8eea0 service nova] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-28d368ed-2d57-4bbd-b4f1-06fb4451b0e1 req-3f1d0730-1c45-4c89-82f9-fc7c78d8eea0 service nova] Lock "9b6f739d-461c-48a4-a4a7-5eebbca38913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-28d368ed-2d57-4bbd-b4f1-06fb4451b0e1 req-3f1d0730-1c45-4c89-82f9-fc7c78d8eea0 service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] No waiting events found dispatching network-vif-plugged-982a753c-a6ca-4884-b3ac-9f6769b439cd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:55:06 user nova-compute[74278]: WARNING nova.compute.manager [req-28d368ed-2d57-4bbd-b4f1-06fb4451b0e1 req-3f1d0730-1c45-4c89-82f9-fc7c78d8eea0 service nova] [instance: 9b6f739d-461c-48a4-a4a7-5eebbca38913] Received unexpected event network-vif-plugged-982a753c-a6ca-4884-b3ac-9f6769b439cd for instance with vm_state deleted and task_state None.
Oct 30 10:55:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:13 user nova-compute[74278]: INFO nova.compute.manager [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Rescuing
Oct 30 10:55:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:55:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquired lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:55:13 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:55:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Updating instance_info_cache with network_info: [{"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:55:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Releasing lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:55:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-57719465-ec62-4745-8416-c122b2d591f2 req-3a3904dc-049c-4e14-b515-e8bceba50d95 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-unplugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:55:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-57719465-ec62-4745-8416-c122b2d591f2 req-3a3904dc-049c-4e14-b515-e8bceba50d95 service nova] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-57719465-ec62-4745-8416-c122b2d591f2 req-3a3904dc-049c-4e14-b515-e8bceba50d95 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-57719465-ec62-4745-8416-c122b2d591f2 req-3a3904dc-049c-4e14-b515-e8bceba50d95 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-57719465-ec62-4745-8416-c122b2d591f2 req-3a3904dc-049c-4e14-b515-e8bceba50d95 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] No waiting events found dispatching network-vif-unplugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:55:14 user nova-compute[74278]: WARNING nova.compute.manager [req-57719465-ec62-4745-8416-c122b2d591f2 req-3a3904dc-049c-4e14-b515-e8bceba50d95 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received unexpected event network-vif-unplugged-f8d17d66-8240-41ca-855d-531672079adb for instance with vm_state active and task_state rescuing.
Oct 30 10:55:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:15 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Instance destroyed successfully.
Oct 30 10:55:15 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Attempting a stable device rescue
Oct 30 10:55:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74278) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 10:55:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Instance directory exists: not creating {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 10:55:15 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Creating image(s)
Oct 30 10:55:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "/opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "/opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "/opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:15 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2591f731-03b7-49b6-93af-c5b63e505127 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:55:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "60c12122be8c107b452ba200720811a80b48a315" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "60c12122be8c107b452ba200720811a80b48a315" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315.part --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Starting finish_migration {{(pid=74278) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Instance directory exists: not creating {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 10:55:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Creating image(s)
Oct 30 10:55:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG nova.virt.images [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] e7aa624c-2e89-4aed-bddd-68decd38368a was qcow2, converting to raw {{(pid=74278) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315.part /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315.converted {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG nova.compute.manager [req-d48b3b56-c7ad-49e4-9fcd-57ed35d1ed92 req-e7de0cb9-a945-4ff9-8756-4a3667b72e12 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d48b3b56-c7ad-49e4-9fcd-57ed35d1ed92 req-e7de0cb9-a945-4ff9-8756-4a3667b72e12 service nova] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d48b3b56-c7ad-49e4-9fcd-57ed35d1ed92 req-e7de0cb9-a945-4ff9-8756-4a3667b72e12 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d48b3b56-c7ad-49e4-9fcd-57ed35d1ed92 req-e7de0cb9-a945-4ff9-8756-4a3667b72e12 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG nova.compute.manager [req-d48b3b56-c7ad-49e4-9fcd-57ed35d1ed92 req-e7de0cb9-a945-4ff9-8756-4a3667b72e12 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] No waiting events found dispatching network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:55:16 user nova-compute[74278]: WARNING nova.compute.manager [req-d48b3b56-c7ad-49e4-9fcd-57ed35d1ed92 req-e7de0cb9-a945-4ff9-8756-4a3667b72e12 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received unexpected event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb for instance with vm_state active and task_state rescuing.
Oct 30 10:55:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.209s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk. size=21474836480 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315.part /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315.converted" returned: 0 in 0.357s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315.converted --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk 21474836480 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk 21474836480" returned: 0 in 0.057s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Ensure instance console log exists: /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Start _get_guest_xml network_info=[{"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-339457430-network", "vif_mac": "fa:16:3e:8b:ee:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxUyZTWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '25c5ad55-f85b-4371-8bdf-95a6a0f4d73d', 'attached_at': '2023-10-30T10:55:15.000000', 'detached_at': '', 'volume_id': 'e0066f51-c274-4eea-9f0c-8acdcded086c', 'serial': 'e0066f51-c274-4eea-9f0c-8acdcded086c'}, 'attachment_id': '3761b175-9e56-4455-8be1-e6abc8f4b9c3', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:55:17 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:55:17 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxUyZTWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:55:17 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:55:17 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:55:17 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "60c12122be8c107b452ba200720811a80b48a315" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.943s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "60c12122be8c107b452ba200720811a80b48a315" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "60c12122be8c107b452ba200720811a80b48a315" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d48af3-6e88-4479-b2a2-a32f232a86a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:55:17 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c3d689-4593-4d3b-a0e9-7b8f9911a548]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c] added
Oct 30 10:55:17 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3749018-de82-48f0-bc37-7751b3668b71]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7483b4-c588-463f-8477-12f0110c0b54]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxUyZTWd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxUyZTWd" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[97380ad3-079d-4d88-bfab-9997e79784ca]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FxUyZTWd'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc09ece0-fa82-430d-b15f-49f37d31cc41]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc89e6ac-c848-4c81-94d9-190285c9b8e1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:55:17 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:55:17 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:55:17 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:55:17 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315 --force-share --output=json" returned: 0 in 0.207s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315,backing_fmt=raw /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.rescue {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[560e825b-cd4c-4e13-9815-9ebad494df36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260]
Oct 30 10:55:17 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260] successful.
Oct 30 10:55:17 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315,backing_fmt=raw /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.rescue" returned: 0 in 0.063s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "60c12122be8c107b452ba200720811a80b48a315" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'migration_context' on Instance uuid 2591f731-03b7-49b6-93af-c5b63e505127 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db9125f-d949-4ff3-82fb-e1805c3408bd]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.objects.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Object Instance<2591f731-03b7-49b6-93af-c5b63e505127> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Start _get_guest_xml network_info=[{"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "vif_mac": "fa:16:3e:87:1d:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e7aa624c-2e89-4aed-bddd-68decd38368a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDvLNukE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '2591f731-03b7-49b6-93af-c5b63e505127', 'attached_at': '', 'detached_at': '', 'volume_id': '32778937-dac7-439c-89b4-6275dcdc17a1', 'serial': '32778937-dac7-439c-89b4-6275dcdc17a1'}, 'attachment_id': 'faa30bfb-945e-4a6a-94fa-d89a1a6d3e73', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'resources' on Instance uuid 2591f731-03b7-49b6-93af-c5b63e505127 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.objects.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Object Instance<2591f731-03b7-49b6-93af-c5b63e505127> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'numa_topology' on Instance uuid 2591f731-03b7-49b6-93af-c5b63e505127 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b52556-1a6d-4e97-b024-330f9178876d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:55:17 user nova-compute[74278]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:55:17 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:55:17 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:55:17 user nova-compute[74278]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:55:17 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:55:17 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.objects.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Object Instance<2591f731-03b7-49b6-93af-c5b63e505127> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:17 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:55:17 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2591f731-03b7-49b6-93af-c5b63e505127 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[249c387a-f6ab-48f4-9375-667cd050913d]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxUyZTWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.objects.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Object Instance<2591f731-03b7-49b6-93af-c5b63e505127> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDvLNukE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:55:17 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:55:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26133663466313931', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133663466313931', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.952s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:55:18 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:55:18 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1968ae-8cae-41be-b08d-55fd6710c4de]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xDvLNukE\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 30 10:55:18 user nova-compute[74278]: node.name = iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:55:18 user nova-compute[74278]: node.tpgt = -1
Oct 30 10:55:18 user nova-compute[74278]: node.startup = automatic
Oct 30 10:55:18 user nova-compute[74278]: node.leading_login = No
Oct 30 10:55:18 user nova-compute[74278]: iface.iscsi_ifacename = default
Oct 30 10:55:18 user nova-compute[74278]: iface.net_ifacename = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.ipaddress = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.prefix_len = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.hwaddress = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.transport_name = tcp
Oct 30 10:55:18 user nova-compute[74278]: iface.initiatorname = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.state = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.vlan_id = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.vlan_priority = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.vlan_state = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.iface_num = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.mtu = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.port = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.bootproto = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.subnet_mask = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.gateway = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.dhcp_alt_client_id_state = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.dhcp_alt_client_id = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.dhcp_dns = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.dhcp_learn_iqn = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.dhcp_req_vendor_id_state = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.dhcp_vendor_id_state = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.dhcp_vendor_id = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.dhcp_slp_da = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.fragmentation = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.gratuitous_arp = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.incoming_forwarding = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.tos_state = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.tos = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.ttl = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.delayed_ack = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.tcp_nagle = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.tcp_wsf_state = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.tcp_wsf = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.tcp_timer_scale = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.tcp_timestamp = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.redirect = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.def_task_mgmt_timeout = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.header_digest = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.data_digest = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.immediate_data = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.initial_r2t = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.data_seq_inorder = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.data_pdu_inorder = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.erl = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.max_receive_data_len = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.first_burst_len = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.max_outstanding_r2t = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.max_burst_len = 0
Oct 30 10:55:18 user nova-compute[74278]: iface.chap_auth = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.bidi_chap = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.strict_login_compliance = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.discovery_auth = <empty>
Oct 30 10:55:18 user nova-compute[74278]: iface.discovery_logout = <empty>
Oct 30 10:55:18 user nova-compute[74278]: node.discovery_address = <empty>
Oct 30 10:55:18 user nova-compute[74278]: node.discovery_port = 0
Oct 30 10:55:18 user nova-compute[74278]: node.discovery_type = static
Oct 30 10:55:18 user nova-compute[74278]: node.session.initial_cmdsn = 0
Oct 30 10:55:18 user nova-compute[74278]: node.session.initial_login_retry_max = 8
Oct 30 10:55:18 user nova-compute[74278]: node.session.xmit_thread_priority = -20
Oct 30 10:55:18 user nova-compute[74278]: node.session.cmds_max = 128
Oct 30 10:55:18 user nova-compute[74278]: node.session.queue_depth = 32
Oct 30 10:55:18 user nova-compute[74278]: node.session.nr_sessions = 1
Oct 30 10:55:18 user nova-compute[74278]: node.session.auth.authmethod = CHAP
Oct 30 10:55:18 user nova-compute[74278]: node.session.auth.username = xDvLNukE
Oct 30 10:55:18 user nova-compute[74278]: node.session.auth.password = ***
Oct 30 10:55:18 user nova-compute[74278]: node.session.auth.username_in = <empty>
Oct 30 10:55:18 user nova-compute[74278]: node.session.auth.password_in = <empty>
Oct 30 10:55:18 user nova-compute[74278]: node.session.auth.chap_algs = MD5
Oct 30 10:55:18 user nova-compute[74278]: node.session.timeo.replacement_timeout = 120
Oct 30 10:55:18 user nova-compute[74278]: node.session.err_timeo.abort_timeout = 15
Oct 30 10:55:18 user nova-compute[74278]: node.session.err_timeo.lu_reset_timeout = 30
Oct 30 10:55:18 user nova-compute[74278]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 30 10:55:18 user nova-compute[74278]: node.session.err_timeo.host_reset_timeout = 60
Oct 30 10:55:18 user nova-compute[74278]: node.session.iscsi.FastAbort = Yes
Oct 30 10:55:18 user nova-compute[74278]: node.session.iscsi.InitialR2T = No
Oct 30 10:55:18 user nova-compute[74278]: node.session.iscsi.ImmediateData = Yes
Oct 30 10:55:18 user nova-compute[74278]: node.session.iscsi.FirstBurstLength = 262144
Oct 30 10:55:18 user nova-compute[74278]: node.session.iscsi.MaxBurstLength = 16776192
Oct 30 10:55:18 user nova-compute[74278]: node.session.iscsi.DefaultTime2Retain = 0
Oct 30 10:55:18 user nova-compute[74278]: node.session.iscsi.DefaultTime2Wait = 2
Oct 30 10:55:18 user nova-compute[74278]: node.session.iscsi.MaxConnections = 1
Oct 30 10:55:18 user nova-compute[74278]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 30 10:55:18 user nova-compute[74278]: node.session.iscsi.ERL = 0
Oct 30 10:55:18 user nova-compute[74278]: node.session.scan = manual
Oct 30 10:55:18 user nova-compute[74278]: node.session.reopen_max = 0
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].address = 172.16.0.220
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].port = 3260
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].startup = manual
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].tcp.window_size = 524288
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].tcp.type_of_service = 0
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].timeo.logout_timeout = 15
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].timeo.login_timeout = 15
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].timeo.auth_timeout = 45
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].timeo.noop_out_interval = 5
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].timeo.noop_out_timeout = 5
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].iscsi.HeaderDigest = None
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].iscsi.DataDigest = None
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].iscsi.IFMarker = No
Oct 30 10:55:18 user nova-compute[74278]: node.conn[0].iscsi.OFMarker = No
Oct 30 10:55:18 user nova-compute[74278]: # END RECORD
Oct 30 10:55:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1697547587',display_name='tempest-ServerActionsTestOtherB-server-1697547587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1697547587',id=4,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxtrS9IHVw9VJCYjUF6eDWBKHwb7bFWD3A669NQggiEpEfM7XQnDLYLkziVDxGhK2ctlm9Mx1VSfhVfRehAdJNYHfhfvjHZCeNc+QL1vrbZckvK1AnRE3E7SPpnRLWh5Q==',key_name='tempest-keypair-979570287',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:50:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a59c309805c1416793e76777407ef388',ramdisk_id='',reservation_id='r-f0ytqg1f',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1708015848',owner_user_name='tempest-ServerActionsTestOtherB-1708015848-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7002e346bd664217af927725af208c54',uuid=25c5ad55-f85b-4371-8bdf-95a6a0f4d73d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-339457430-network", "vif_mac": "fa:16:3e:8b:ee:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converting VIF {"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-339457430-network", "vif_mac": "fa:16:3e:8b:ee:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:55:18 user nova-compute[74278]:   <uuid>25c5ad55-f85b-4371-8bdf-95a6a0f4d73d</uuid>
Oct 30 10:55:18 user nova-compute[74278]:   <name>instance-00000004</name>
Oct 30 10:55:18 user nova-compute[74278]:   <memory>2097152</memory>
Oct 30 10:55:18 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:55:18 user nova-compute[74278]:   <metadata>
Oct 30 10:55:18 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:55:18 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:55:18 user nova-compute[74278]:       <nova:name>tempest-ServerActionsTestOtherB-server-1697547587</nova:name>
Oct 30 10:55:18 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:55:17</nova:creationTime>
Oct 30 10:55:18 user nova-compute[74278]:       <nova:flavor name="m1.small">
Oct 30 10:55:18 user nova-compute[74278]:         <nova:memory>2048</nova:memory>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:disk>20</nova:disk>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:55:18 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:55:18 user nova-compute[74278]:       <nova:owner>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:user uuid="7002e346bd664217af927725af208c54">tempest-ServerActionsTestOtherB-1708015848-project-member</nova:user>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:project uuid="a59c309805c1416793e76777407ef388">tempest-ServerActionsTestOtherB-1708015848</nova:project>
Oct 30 10:55:18 user nova-compute[74278]:       </nova:owner>
Oct 30 10:55:18 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:55:18 user nova-compute[74278]:       <nova:ports>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:port uuid="346d37bb-4749-43ab-b83e-c0472def78b2">
Oct 30 10:55:18 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 10:55:18 user nova-compute[74278]:         </nova:port>
Oct 30 10:55:18 user nova-compute[74278]:       </nova:ports>
Oct 30 10:55:18 user nova-compute[74278]:     </nova:instance>
Oct 30 10:55:18 user nova-compute[74278]:   </metadata>
Oct 30 10:55:18 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:55:18 user nova-compute[74278]:     <system>
Oct 30 10:55:18 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:55:18 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:55:18 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:55:18 user nova-compute[74278]:       <entry name="serial">25c5ad55-f85b-4371-8bdf-95a6a0f4d73d</entry>
Oct 30 10:55:18 user nova-compute[74278]:       <entry name="uuid">25c5ad55-f85b-4371-8bdf-95a6a0f4d73d</entry>
Oct 30 10:55:18 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:55:18 user nova-compute[74278]:     </system>
Oct 30 10:55:18 user nova-compute[74278]:   </sysinfo>
Oct 30 10:55:18 user nova-compute[74278]:   <os>
Oct 30 10:55:18 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:55:18 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:55:18 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:55:18 user nova-compute[74278]:   </os>
Oct 30 10:55:18 user nova-compute[74278]:   <features>
Oct 30 10:55:18 user nova-compute[74278]:     <acpi/>
Oct 30 10:55:18 user nova-compute[74278]:     <apic/>
Oct 30 10:55:18 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:55:18 user nova-compute[74278]:   </features>
Oct 30 10:55:18 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:55:18 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:55:18 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:55:18 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:55:18 user nova-compute[74278]:   </clock>
Oct 30 10:55:18 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:55:18 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:55:18 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:55:18 user nova-compute[74278]:   </cpu>
Oct 30 10:55:18 user nova-compute[74278]:   <devices>
Oct 30 10:55:18 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:55:18 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:55:18 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk"/>
Oct 30 10:55:18 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:55:18 user nova-compute[74278]:     </disk>
Oct 30 10:55:18 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 10:55:18 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:55:18 user nova-compute[74278]:       <source dev="/dev/sdc"/>
Oct 30 10:55:18 user nova-compute[74278]:       <target dev="vdb" bus="virtio"/>
Oct 30 10:55:18 user nova-compute[74278]:       <serial>e0066f51-c274-4eea-9f0c-8acdcded086c</serial>
Oct 30 10:55:18 user nova-compute[74278]:     </disk>
Oct 30 10:55:18 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:55:18 user nova-compute[74278]:       <mac address="fa:16:3e:8b:ee:5f"/>
Oct 30 10:55:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:55:18 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:55:18 user nova-compute[74278]:       <target dev="tap346d37bb-47"/>
Oct 30 10:55:18 user nova-compute[74278]:     </interface>
Oct 30 10:55:18 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:55:18 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/console.log" append="off"/>
Oct 30 10:55:18 user nova-compute[74278]:     </serial>
Oct 30 10:55:18 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:55:18 user nova-compute[74278]:     <video>
Oct 30 10:55:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:55:18 user nova-compute[74278]:     </video>
Oct 30 10:55:18 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:55:18 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:55:18 user nova-compute[74278]:     </rng>
Oct 30 10:55:18 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:55:18 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:55:18 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:55:18 user nova-compute[74278]:     </memballoon>
Oct 30 10:55:18 user nova-compute[74278]:   </devices>
Oct 30 10:55:18 user nova-compute[74278]: </domain>
Oct 30 10:55:18 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1697547587',display_name='tempest-ServerActionsTestOtherB-server-1697547587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1697547587',id=4,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxtrS9IHVw9VJCYjUF6eDWBKHwb7bFWD3A669NQggiEpEfM7XQnDLYLkziVDxGhK2ctlm9Mx1VSfhVfRehAdJNYHfhfvjHZCeNc+QL1vrbZckvK1AnRE3E7SPpnRLWh5Q==',key_name='tempest-keypair-979570287',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:50:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a59c309805c1416793e76777407ef388',ramdisk_id='',reservation_id='r-f0ytqg1f',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1708015848',owner_user_name='tempest-ServerActionsTestOtherB-1708015848-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7002e346bd664217af927725af208c54',uuid=25c5ad55-f85b-4371-8bdf-95a6a0f4d73d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-339457430-network", "vif_mac": "fa:16:3e:8b:ee:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converting VIF {"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-339457430-network", "vif_mac": "fa:16:3e:8b:ee:5f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_vif [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8c1aa7a-a83b-53c9-bfbd-11924bfc616d', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0c2e6f-cf22-48e2-8569-98d9e5950179]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap346d37bb-47, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap346d37bb-47, col_values=(('qos', UUID('547e2434-6a4b-4652-b388-2b0719cc73ad')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap346d37bb-47, col_values=(('external_ids', {'iface-id': '346d37bb-4749-43ab-b83e-c0472def78b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:ee:5f', 'vm-uuid': '25c5ad55-f85b-4371-8bdf-95a6a0f4d73d'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5354cdc9-6848-4809-986f-7af6853a1a47]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xDvLNukE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:18 user nova-compute[74278]: INFO os_vif [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47')
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xDvLNukE" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8034cd5-387f-4d5e-af47-acd25698887b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xDvLNukE'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ca6a89-ab2f-4bd8-8409-65fb563245eb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[278b06fe-ff49-4b30-bddf-e86b33e45e19]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:55:18 user nova-compute[74278]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:55:18 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:55:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:55:18 user nova-compute[74278]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:55:18 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:55:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] HCTL ('37', '0', '0', 0) found on session 11 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] No VIF found with MAC fa:16:3e:8b:ee:5f, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcfa6bf-e0a9-433d-aac8-3d3b79748690]: (4, ('0 0 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching for a device in session 11 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDvLNukE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] <== connect_volume: return (1133ms) {'type': 'block', 'scsi_wwn': '26332613038636338', 'path': '/dev/sdf'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332613038636338', 'path': '/dev/sdf'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-716124331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-716124331',id=13,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-guw9p7hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:54:08Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=2591f731-03b7-49b6-93af-c5b63e505127,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "vif_mac": "fa:16:3e:87:1d:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "vif_mac": "fa:16:3e:87:1d:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:1d:9a,bridge_name='br-int',has_traffic_filtering=True,id=f8d17d66-8240-41ca-855d-531672079adb,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d17d66-82') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'pci_devices' on Instance uuid 2591f731-03b7-49b6-93af-c5b63e505127 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.objects.base [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Object Instance<2591f731-03b7-49b6-93af-c5b63e505127> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:55:18 user nova-compute[74278]:   <uuid>2591f731-03b7-49b6-93af-c5b63e505127</uuid>
Oct 30 10:55:18 user nova-compute[74278]:   <name>instance-0000000d</name>
Oct 30 10:55:18 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:55:18 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:55:18 user nova-compute[74278]:   <metadata>
Oct 30 10:55:18 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:55:18 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:55:18 user nova-compute[74278]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-716124331</nova:name>
Oct 30 10:55:18 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:55:17</nova:creationTime>
Oct 30 10:55:18 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:55:18 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:55:18 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:55:18 user nova-compute[74278]:       <nova:owner>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:user uuid="e6e338955c2f4d4fae81e9fbf93eff39">tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member</nova:user>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:project uuid="0f6de366be034e23a4d60302674b76c9">tempest-ServerBootFromVolumeStableRescueTest-1058902108</nova:project>
Oct 30 10:55:18 user nova-compute[74278]:       </nova:owner>
Oct 30 10:55:18 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:55:18 user nova-compute[74278]:       <nova:ports>
Oct 30 10:55:18 user nova-compute[74278]:         <nova:port uuid="f8d17d66-8240-41ca-855d-531672079adb">
Oct 30 10:55:18 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 10:55:18 user nova-compute[74278]:         </nova:port>
Oct 30 10:55:18 user nova-compute[74278]:       </nova:ports>
Oct 30 10:55:18 user nova-compute[74278]:     </nova:instance>
Oct 30 10:55:18 user nova-compute[74278]:   </metadata>
Oct 30 10:55:18 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:55:18 user nova-compute[74278]:     <system>
Oct 30 10:55:18 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:55:18 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:55:18 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:55:18 user nova-compute[74278]:       <entry name="serial">2591f731-03b7-49b6-93af-c5b63e505127</entry>
Oct 30 10:55:18 user nova-compute[74278]:       <entry name="uuid">2591f731-03b7-49b6-93af-c5b63e505127</entry>
Oct 30 10:55:18 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:55:18 user nova-compute[74278]:     </system>
Oct 30 10:55:18 user nova-compute[74278]:   </sysinfo>
Oct 30 10:55:18 user nova-compute[74278]:   <os>
Oct 30 10:55:18 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:55:18 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:55:18 user nova-compute[74278]:   </os>
Oct 30 10:55:18 user nova-compute[74278]:   <features>
Oct 30 10:55:18 user nova-compute[74278]:     <acpi/>
Oct 30 10:55:18 user nova-compute[74278]:     <apic/>
Oct 30 10:55:18 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:55:18 user nova-compute[74278]:   </features>
Oct 30 10:55:18 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:55:18 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:55:18 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:55:18 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:55:18 user nova-compute[74278]:   </clock>
Oct 30 10:55:18 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:55:18 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:55:18 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:55:18 user nova-compute[74278]:   </cpu>
Oct 30 10:55:18 user nova-compute[74278]:   <devices>
Oct 30 10:55:18 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 10:55:18 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:55:18 user nova-compute[74278]:       <source dev="/dev/sdf"/>
Oct 30 10:55:18 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:55:18 user nova-compute[74278]:       <serial>32778937-dac7-439c-89b4-6275dcdc17a1</serial>
Oct 30 10:55:18 user nova-compute[74278]:     </disk>
Oct 30 10:55:18 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:55:18 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:55:18 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.rescue"/>
Oct 30 10:55:18 user nova-compute[74278]:       <target dev="vdb" bus="virtio"/>
Oct 30 10:55:18 user nova-compute[74278]:       <boot order="1"/>
Oct 30 10:55:18 user nova-compute[74278]:     </disk>
Oct 30 10:55:18 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:55:18 user nova-compute[74278]:       <mac address="fa:16:3e:87:1d:9a"/>
Oct 30 10:55:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:55:18 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:55:18 user nova-compute[74278]:       <target dev="tapf8d17d66-82"/>
Oct 30 10:55:18 user nova-compute[74278]:     </interface>
Oct 30 10:55:18 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:55:18 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/console.log" append="off"/>
Oct 30 10:55:18 user nova-compute[74278]:     </serial>
Oct 30 10:55:18 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:55:18 user nova-compute[74278]:     <video>
Oct 30 10:55:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:55:18 user nova-compute[74278]:     </video>
Oct 30 10:55:18 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:55:18 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:55:18 user nova-compute[74278]:     </rng>
Oct 30 10:55:18 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:55:18 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:55:18 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:55:18 user nova-compute[74278]:     </memballoon>
Oct 30 10:55:18 user nova-compute[74278]:   </devices>
Oct 30 10:55:18 user nova-compute[74278]: </domain>
Oct 30 10:55:18 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:55:18 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Instance destroyed successfully.
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No VIF found with MAC fa:16:3e:87:1d:9a, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:55:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:19 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:55:19 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:55:19 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:55:20 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:55:20 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:55:20 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:55:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-84448e30-982f-4214-a61e-8cc5e122aef3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:55:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-84448e30-982f-4214-a61e-8cc5e122aef3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:55:20 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-bff1fe68-1494-4fe9-9c69-33b85d711542 req-42a49a12-c337-4de5-8533-33ff9aa7b525 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bff1fe68-1494-4fe9-9c69-33b85d711542 req-42a49a12-c337-4de5-8533-33ff9aa7b525 service nova] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bff1fe68-1494-4fe9-9c69-33b85d711542 req-42a49a12-c337-4de5-8533-33ff9aa7b525 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bff1fe68-1494-4fe9-9c69-33b85d711542 req-42a49a12-c337-4de5-8533-33ff9aa7b525 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-bff1fe68-1494-4fe9-9c69-33b85d711542 req-42a49a12-c337-4de5-8533-33ff9aa7b525 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] No waiting events found dispatching network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:55:21 user nova-compute[74278]: WARNING nova.compute.manager [req-bff1fe68-1494-4fe9-9c69-33b85d711542 req-42a49a12-c337-4de5-8533-33ff9aa7b525 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received unexpected event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 for instance with vm_state active and task_state resize_finish.
Oct 30 10:55:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Updating instance_info_cache with network_info: [{"id": "be704baf-2542-497e-af45-bffa287fc1cd", "address": "fa:16:3e:27:25:f0", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe704baf-25", "ovs_interfaceid": "be704baf-2542-497e-af45-bffa287fc1cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-84448e30-982f-4214-a61e-8cc5e122aef3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:21 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:55:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:55:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] No waiting events found dispatching network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:55:23 user nova-compute[74278]: WARNING nova.compute.manager [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received unexpected event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 for instance with vm_state active and task_state resize_finish.
Oct 30 10:55:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] No waiting events found dispatching network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:55:23 user nova-compute[74278]: WARNING nova.compute.manager [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received unexpected event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb for instance with vm_state active and task_state rescuing.
Oct 30 10:55:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] No waiting events found dispatching network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:55:23 user nova-compute[74278]: WARNING nova.compute.manager [req-3b48e8d0-ecf7-43ac-b207-7d2cbb7715ea req-fb552abe-f304-4ab8-bb98-3b07971e4ac0 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received unexpected event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb for instance with vm_state active and task_state rescuing.
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:55:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:55:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1660a378-7873-40e4-a3aa-443254769534 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:55:24 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Instance running successfully.
Oct 30 10:55:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Failed to set time: agent not configured {{(pid=74278) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 30 10:55:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c7fa0a9c-cbed-47f3-9b6b-b4d4cfd6057c tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] finish_migration finished successfully. {{(pid=74278) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 30 10:55:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:55:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:26 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:55:26 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7626MB free_disk=25.158702850341797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Applying migration context for instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d as it has an incoming, in-progress migration 8227d4a9-05b8-4c9a-8e51-bdff91fa8bdf. Migration status is finished {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 30 10:55:26 user nova-compute[74278]: INFO nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating resource usage from migration 8227d4a9-05b8-4c9a-8e51-bdff91fa8bdf
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 55cf7cd9-4e0b-4caa-874e-4963079e3b10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 84448e30-982f-4214-a61e-8cc5e122aef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance b5d47df1-5569-433d-bf6a-42b5e04196fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Migration 8227d4a9-05b8-4c9a-8e51-bdff91fa8bdf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:55:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:55:27 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:55:27 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:55:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:55:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.818s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:55:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:55:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-d7ebf351-1afa-4d54-a09e-34f5215e859f req-0ee3e4cb-2d30-4386-8f91-973bf3084b64 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-changed-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:55:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-d7ebf351-1afa-4d54-a09e-34f5215e859f req-0ee3e4cb-2d30-4386-8f91-973bf3084b64 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Refreshing instance network info cache due to event network-changed-c2c68f43-b884-4bf0-8948-447c35ce1402. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:55:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d7ebf351-1afa-4d54-a09e-34f5215e859f req-0ee3e4cb-2d30-4386-8f91-973bf3084b64 service nova] Acquiring lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:55:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d7ebf351-1afa-4d54-a09e-34f5215e859f req-0ee3e4cb-2d30-4386-8f91-973bf3084b64 service nova] Acquired lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:55:50 user nova-compute[74278]: DEBUG nova.network.neutron [req-d7ebf351-1afa-4d54-a09e-34f5215e859f req-0ee3e4cb-2d30-4386-8f91-973bf3084b64 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Refreshing network info cache for port c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:55:51 user nova-compute[74278]: DEBUG nova.network.neutron [req-d7ebf351-1afa-4d54-a09e-34f5215e859f req-0ee3e4cb-2d30-4386-8f91-973bf3084b64 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Updated VIF entry in instance network info cache for port c2c68f43-b884-4bf0-8948-447c35ce1402. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:55:51 user nova-compute[74278]: DEBUG nova.network.neutron [req-d7ebf351-1afa-4d54-a09e-34f5215e859f req-0ee3e4cb-2d30-4386-8f91-973bf3084b64 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Updating instance_info_cache with network_info: [{"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:55:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d7ebf351-1afa-4d54-a09e-34f5215e859f req-0ee3e4cb-2d30-4386-8f91-973bf3084b64 service nova] Releasing lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:55:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "84448e30-982f-4214-a61e-8cc5e122aef3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "84448e30-982f-4214-a61e-8cc5e122aef3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:57 user nova-compute[74278]: INFO nova.compute.manager [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Detaching volume b83bfcc3-9672-497c-9efb-20674076c7a6
Oct 30 10:55:57 user nova-compute[74278]: INFO nova.virt.block_device [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Attempting to driver detach volume b83bfcc3-9672-497c-9efb-20674076c7a6 from mountpoint /dev/vdb
Oct 30 10:55:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Attempting to detach device vdb from instance 84448e30-982f-4214-a61e-8cc5e122aef3 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 10:55:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 10:55:57 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:55:57 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 10:55:57 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:55:57 user nova-compute[74278]:   <serial>b83bfcc3-9672-497c-9efb-20674076c7a6</serial>
Oct 30 10:55:57 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 10:55:57 user nova-compute[74278]: </disk>
Oct 30 10:55:57 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:55:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully detached device vdb from instance 84448e30-982f-4214-a61e-8cc5e122aef3 from the persistent domain config.
Oct 30 10:55:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84448e30-982f-4214-a61e-8cc5e122aef3 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 10:55:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 10:55:57 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:55:57 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 10:55:57 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:55:57 user nova-compute[74278]:   <serial>b83bfcc3-9672-497c-9efb-20674076c7a6</serial>
Oct 30 10:55:57 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 10:55:57 user nova-compute[74278]: </disk>
Oct 30 10:55:57 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:55:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84448e30-982f-4214-a61e-8cc5e122aef3 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 10:55:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:57 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:55:58 user nova-compute[74278]: INFO nova.compute.manager [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Attaching volume c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 to /dev/vdb
Oct 30 10:55:58 user nova-compute[74278]: DEBUG os_brick.utils [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95ee875-391a-4b46-ad6d-b414a1279965]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[663ff19c-a7e4-4b64-b8dc-357aa3c1688b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a736a2-4506-4901-a198-9dbe00d3e508]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66f79c7-8a6c-475d-aac3-66b21eeccab8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:55:58 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:55:58 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6798dc24-53ee-403d-9349-10785d4647ae]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG os_brick.utils [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Updating existing volume attachment record: 32ea9bf5-6f8a-4b6f-a7f7-839937f1ead8 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:55:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-7e122e7b-cfaa-4da1-8056-03342604bd2b req-38b09857-ebd2-4f17-b3b0-a46fb722f8b3 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Received event network-changed-61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-7e122e7b-cfaa-4da1-8056-03342604bd2b req-38b09857-ebd2-4f17-b3b0-a46fb722f8b3 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Refreshing instance network info cache due to event network-changed-61fae496-e8ce-41d0-99e9-f718e37e8ff6. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:56:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7e122e7b-cfaa-4da1-8056-03342604bd2b req-38b09857-ebd2-4f17-b3b0-a46fb722f8b3 service nova] Acquiring lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7e122e7b-cfaa-4da1-8056-03342604bd2b req-38b09857-ebd2-4f17-b3b0-a46fb722f8b3 service nova] Acquired lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:08 user nova-compute[74278]: DEBUG nova.network.neutron [req-7e122e7b-cfaa-4da1-8056-03342604bd2b req-38b09857-ebd2-4f17-b3b0-a46fb722f8b3 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Refreshing network info cache for port 61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:56:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG nova.objects.instance [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lazy-loading 'flavor' on Instance uuid 9cba7c39-a2d1-44c0-a866-01c22a3f3634 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG nova.network.neutron [req-7e122e7b-cfaa-4da1-8056-03342604bd2b req-38b09857-ebd2-4f17-b3b0-a46fb722f8b3 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Updated VIF entry in instance network info cache for port 61fae496-e8ce-41d0-99e9-f718e37e8ff6. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG nova.network.neutron [req-7e122e7b-cfaa-4da1-8056-03342604bd2b req-38b09857-ebd2-4f17-b3b0-a46fb722f8b3 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Updating instance_info_cache with network_info: [{"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7e122e7b-cfaa-4da1-8056-03342604bd2b req-38b09857-ebd2-4f17-b3b0-a46fb722f8b3 service nova] Releasing lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:09 user nova-compute[74278]: INFO nova.compute.manager [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Attaching volume e0e4421e-6f87-40ec-9095-9810114767e1 to /dev/vdb
Oct 30 10:56:09 user nova-compute[74278]: DEBUG os_brick.utils [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[469c8729-2410-446c-8235-7d0ef794db3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c24f53-35ea-4efe-8aa0-6d46c073f0ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd499875-6e5a-4be9-9bc4-1407ee3e8ea4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a30afc-e1a2-4e95-a2d5-97d2820beb4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:56:10 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:56:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b4848d-82d3-4e21-84e6-b73fc11fef1b]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG os_brick.utils [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:56:10 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Updating existing volume attachment record: c03ffda5-96c0-4fbb-a42d-5dc1d5d88770 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:56:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:15 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:17 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 84448e30-982f-4214-a61e-8cc5e122aef3 is timed out.
Oct 30 10:56:17 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully detached device vdb from instance 84448e30-982f-4214-a61e-8cc5e122aef3 from the live domain config.
Oct 30 10:56:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:56:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oTmqxecC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:56:17 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:56:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:56:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:56:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c378a94-c8f6-4e27-8da0-373201a5d55d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:56:17 user nova-compute[74278]: No targets found.
Oct 30 10:56:17 user nova-compute[74278]: iSNS:
Oct 30 10:56:17 user nova-compute[74278]: No targets found.
Oct 30 10:56:17 user nova-compute[74278]: STATIC:
Oct 30 10:56:17 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c
Oct 30 10:56:17 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:56:17 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:56:17 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:56:17 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:56:17 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:56:17 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6
Oct 30 10:56:17 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:56:17 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:56:17 user nova-compute[74278]: FIRMWARE:
Oct 30 10:56:17 user nova-compute[74278]: No targets found.
Oct 30 10:56:17 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:56:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:56:17 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:56:17 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:56:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:56:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[230d971a-281b-41e9-bc5a-bb3f074ada1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[daab8878-813a-4d30-9b8d-7343dda23387]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:56:18 user nova-compute[74278]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:56:18 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:56:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:56:18 user nova-compute[74278]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:56:18 user nova-compute[74278]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 (non-flash)
Oct 30 10:56:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac7cd1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac579cd-7592-49d8-b5d0-28c3ee7f4af8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca92a2c1-f166-4ba7-a3d6-5eafaddc73ac]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d972e85e-dfad-4cb1-a172-dd9529893cac]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f24319f-9e09-4778-a868-715f33351c4d]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6824cd-595a-4d86-bed6-65e8ec560ffb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4218ef2e-5fd4-43d8-8c7e-79c6b927fef2]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6, portal: 172.16.0.220,3260]
Oct 30 10:56:18 user nova-compute[74278]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6, portal: 172.16.0.220,3260] successful.
Oct 30 10:56:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83bfcc3-9672-497c-9efb-20674076c7a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd98752a-28c8-410a-9cb2-71fced091ed7]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] <== disconnect_volume: return (373ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:19 user nova-compute[74278]: DEBUG nova.objects.instance [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'flavor' on Instance uuid 84448e30-982f-4214-a61e-8cc5e122aef3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:56:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fbf40593-59e5-4698-8f69-7a793eec2f6e tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "84448e30-982f-4214-a61e-8cc5e122aef3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.156s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:19 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:20 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:20 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:20 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:20 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geJNihYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:56:21 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:56:21 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:56:21 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c37f0c-1988-4b84-8071-008149440a58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:56:21 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8919693d-4f66-4d51-97b0-b627307d0a6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1] added
Oct 30 10:56:21 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.047s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae74da8-84a6-4799-b8cf-052052ebea96]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed93a1d2-234f-46bb-8777-bb00a7906575]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geJNihYb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geJNihYb" returned: 0 in 0.059s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[670d9dca-b0b8-4fe9-8c2e-a767bc5bc511]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'geJNihYb'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[358cf321-fe52-492e-b35d-57d401f8eb1a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5473f60-ef38-471c-9853-ab63181bbd80]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:56:21 user nova-compute[74278]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:56:21 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:56:21 user nova-compute[74278]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:56:21 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-21d2a8cc-39ee-435e-9936-d1585a9386b7" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-21d2a8cc-39ee-435e-9936-d1585a9386b7" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadd060d-036e-4028-b31b-e6730aba0099]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260]
Oct 30 10:56:21 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260] successful.
Oct 30 10:56:21 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aefb0c-20d0-4351-a7c0-32d6064d0775]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a999812d-9885-41b6-b487-ec40ae27603b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:56:21 user nova-compute[74278]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:56:21 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:56:21 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:56:21 user nova-compute[74278]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:56:21 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:56:21 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f937159-36d9-4542-97d6-f331b300e9db]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:56:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geJNihYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Updating instance_info_cache with network_info: [{"id": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "address": "fa:16:3e:d1:b8:2b", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7b9741-ec", "ovs_interfaceid": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-21d2a8cc-39ee-435e-9936-d1585a9386b7" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '26364393730343739', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364393730343739', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 10:56:22 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:56:22 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 10:56:22 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:56:22 user nova-compute[74278]:   <serial>c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1</serial>
Oct 30 10:56:22 user nova-compute[74278]: </disk>
Oct 30 10:56:22 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No VIF found with MAC fa:16:3e:86:86:a1, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d0d88b5-f2e3-4f87-bfd0-1cb9d37a60bd tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.340s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff0f58e4-d4a0-4df1-9fa0-a89575a0ca04 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff0f58e4-d4a0-4df1-9fa0-a89575a0ca04 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ff0f58e4-d4a0-4df1-9fa0-a89575a0ca04 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ff0f58e4-d4a0-4df1-9fa0-a89575a0ca04 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74278) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG nova.objects.instance [None req-ff0f58e4-d4a0-4df1-9fa0-a89575a0ca04 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG nova.compute.manager [req-b5cd2704-f9c4-406f-b306-3d3f6396b886 req-e9a0a6aa-551e-4360-a0ba-acbaa20f629c service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-vif-unplugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b5cd2704-f9c4-406f-b306-3d3f6396b886 req-e9a0a6aa-551e-4360-a0ba-acbaa20f629c service nova] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b5cd2704-f9c4-406f-b306-3d3f6396b886 req-e9a0a6aa-551e-4360-a0ba-acbaa20f629c service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b5cd2704-f9c4-406f-b306-3d3f6396b886 req-e9a0a6aa-551e-4360-a0ba-acbaa20f629c service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:24 user nova-compute[74278]: DEBUG nova.compute.manager [req-b5cd2704-f9c4-406f-b306-3d3f6396b886 req-e9a0a6aa-551e-4360-a0ba-acbaa20f629c service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] No waiting events found dispatching network-vif-unplugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:56:24 user nova-compute[74278]: WARNING nova.compute.manager [req-b5cd2704-f9c4-406f-b306-3d3f6396b886 req-e9a0a6aa-551e-4360-a0ba-acbaa20f629c service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received unexpected event network-vif-unplugged-c2c68f43-b884-4bf0-8948-447c35ce1402 for instance with vm_state active and task_state powering-off.
Oct 30 10:56:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:25 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance destroyed successfully.
Oct 30 10:56:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ff0f58e4-d4a0-4df1-9fa0-a89575a0ca04 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:56:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:56:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:56:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff0f58e4-d4a0-4df1-9fa0-a89575a0ca04 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.038s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-77e7d8af-2be3-431a-a3ab-e51afbc6846c req-7591d8c7-ec4c-4dac-a060-9997c4ba361a service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-77e7d8af-2be3-431a-a3ab-e51afbc6846c req-7591d8c7-ec4c-4dac-a060-9997c4ba361a service nova] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-77e7d8af-2be3-431a-a3ab-e51afbc6846c req-7591d8c7-ec4c-4dac-a060-9997c4ba361a service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-77e7d8af-2be3-431a-a3ab-e51afbc6846c req-7591d8c7-ec4c-4dac-a060-9997c4ba361a service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-77e7d8af-2be3-431a-a3ab-e51afbc6846c req-7591d8c7-ec4c-4dac-a060-9997c4ba361a service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] No waiting events found dispatching network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:56:27 user nova-compute[74278]: WARNING nova.compute.manager [req-77e7d8af-2be3-431a-a3ab-e51afbc6846c req-7591d8c7-ec4c-4dac-a060-9997c4ba361a service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received unexpected event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 for instance with vm_state stopped and task_state None.
Oct 30 10:56:27 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:56:27 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7466MB free_disk=25.13288116455078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Applying migration context for instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d as it has an incoming, in-progress migration 8227d4a9-05b8-4c9a-8e51-bdff91fa8bdf. Migration status is finished {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 30 10:56:27 user nova-compute[74278]: INFO nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating resource usage from migration 8227d4a9-05b8-4c9a-8e51-bdff91fa8bdf
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 55cf7cd9-4e0b-4caa-874e-4963079e3b10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 84448e30-982f-4214-a61e-8cc5e122aef3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance b5d47df1-5569-433d-bf6a-42b5e04196fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Migration 8227d4a9-05b8-4c9a-8e51-bdff91fa8bdf is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing inventories for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating ProviderTree inventory for provider ce405684-67ab-45d9-bc83-6af4903bfb15 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating inventory in ProviderTree for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing aggregate associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, aggregates: None {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing trait associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.798s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] There are 0 instances to clean {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74278) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 10:56:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "5ed94499-397a-4dc4-94da-13eb67312572" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:56:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:30 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:56:30 user nova-compute[74278]: INFO nova.compute.claims [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Claim successful on node user
Oct 30 10:56:31 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:56:31 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:56:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG nova.policy [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40af50ade2ae4f15821cb93bc8bb8fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '396392292c2446ceaec276ff74a110b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:56:31 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Creating image(s)
Oct 30 10:56:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "/opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "/opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.201s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk 1073741824" returned: 0 in 0.054s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Successfully created port: ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.227s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Cannot resize image /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Ensure instance console log exists: /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Successfully updated port: ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "refresh_cache-5ed94499-397a-4dc4-94da-13eb67312572" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquired lock "refresh_cache-5ed94499-397a-4dc4-94da-13eb67312572" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG nova.compute.manager [req-deed0b4c-f2e9-4055-8672-e0f0272d2cfe req-5309acd6-10f2-43a8-9070-54417343d71e service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Received event network-changed-ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG nova.compute.manager [req-deed0b4c-f2e9-4055-8672-e0f0272d2cfe req-5309acd6-10f2-43a8-9070-54417343d71e service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Refreshing instance network info cache due to event network-changed-ef16226b-834e-4b0a-943c-52883de41281. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:56:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-deed0b4c-f2e9-4055-8672-e0f0272d2cfe req-5309acd6-10f2-43a8-9070-54417343d71e service nova] Acquiring lock "refresh_cache-5ed94499-397a-4dc4-94da-13eb67312572" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Updating instance_info_cache with network_info: [{"id": "ef16226b-834e-4b0a-943c-52883de41281", "address": "fa:16:3e:c1:06:31", "network": {"id": "810116c1-412d-4c6d-b69a-a2f8855639bc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1852542095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396392292c2446ceaec276ff74a110b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef16226b-83", "ovs_interfaceid": "ef16226b-834e-4b0a-943c-52883de41281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Releasing lock "refresh_cache-5ed94499-397a-4dc4-94da-13eb67312572" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Instance network_info: |[{"id": "ef16226b-834e-4b0a-943c-52883de41281", "address": "fa:16:3e:c1:06:31", "network": {"id": "810116c1-412d-4c6d-b69a-a2f8855639bc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1852542095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396392292c2446ceaec276ff74a110b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef16226b-83", "ovs_interfaceid": "ef16226b-834e-4b0a-943c-52883de41281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-deed0b4c-f2e9-4055-8672-e0f0272d2cfe req-5309acd6-10f2-43a8-9070-54417343d71e service nova] Acquired lock "refresh_cache-5ed94499-397a-4dc4-94da-13eb67312572" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.network.neutron [req-deed0b4c-f2e9-4055-8672-e0f0272d2cfe req-5309acd6-10f2-43a8-9070-54417343d71e service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Refreshing network info cache for port ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Start _get_guest_xml network_info=[{"id": "ef16226b-834e-4b0a-943c-52883de41281", "address": "fa:16:3e:c1:06:31", "network": {"id": "810116c1-412d-4c6d-b69a-a2f8855639bc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1852542095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396392292c2446ceaec276ff74a110b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef16226b-83", "ovs_interfaceid": "ef16226b-834e-4b0a-943c-52883de41281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:56:33 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:56:33 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1536753473',display_name='tempest-TestVolumeSwap-server-1536753473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1536753473',id=17,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+dePl6Ki4ZbKbxlHbk3A0QwrN0pxGBfQoZMksM0hCq6dTV7CGNKGX/SSy2+zPmzFQDp8bGih2K2zmMFxuMlN5hwfsFGHeMRTXRB3UGR2x03LtIauQLKdOf6WXuyVD3qA==',key_name='tempest-keypair-1714170783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='396392292c2446ceaec276ff74a110b7',ramdisk_id='',reservation_id='r-0nro4n3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1555628441',owner_user_name='tempest-TestVolumeSwap-1555628441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40af50ade2ae4f15821cb93bc8bb8fb6',uuid=5ed94499-397a-4dc4-94da-13eb67312572,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef16226b-834e-4b0a-943c-52883de41281", "address": "fa:16:3e:c1:06:31", "network": {"id": "810116c1-412d-4c6d-b69a-a2f8855639bc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1852542095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396392292c2446ceaec276ff74a110b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef16226b-83", "ovs_interfaceid": "ef16226b-834e-4b0a-943c-52883de41281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Converting VIF {"id": "ef16226b-834e-4b0a-943c-52883de41281", "address": "fa:16:3e:c1:06:31", "network": {"id": "810116c1-412d-4c6d-b69a-a2f8855639bc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1852542095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396392292c2446ceaec276ff74a110b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef16226b-83", "ovs_interfaceid": "ef16226b-834e-4b0a-943c-52883de41281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:06:31,bridge_name='br-int',has_traffic_filtering=True,id=ef16226b-834e-4b0a-943c-52883de41281,network=Network(810116c1-412d-4c6d-b69a-a2f8855639bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef16226b-83') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ed94499-397a-4dc4-94da-13eb67312572 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:56:33 user nova-compute[74278]:   <uuid>5ed94499-397a-4dc4-94da-13eb67312572</uuid>
Oct 30 10:56:33 user nova-compute[74278]:   <name>instance-00000011</name>
Oct 30 10:56:33 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:56:33 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:56:33 user nova-compute[74278]:   <metadata>
Oct 30 10:56:33 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:56:33 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:56:33 user nova-compute[74278]:       <nova:name>tempest-TestVolumeSwap-server-1536753473</nova:name>
Oct 30 10:56:33 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:56:33</nova:creationTime>
Oct 30 10:56:33 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:56:33 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:56:33 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:56:33 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:56:33 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:56:33 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:56:33 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:56:33 user nova-compute[74278]:       <nova:owner>
Oct 30 10:56:33 user nova-compute[74278]:         <nova:user uuid="40af50ade2ae4f15821cb93bc8bb8fb6">tempest-TestVolumeSwap-1555628441-project-member</nova:user>
Oct 30 10:56:33 user nova-compute[74278]:         <nova:project uuid="396392292c2446ceaec276ff74a110b7">tempest-TestVolumeSwap-1555628441</nova:project>
Oct 30 10:56:33 user nova-compute[74278]:       </nova:owner>
Oct 30 10:56:33 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:56:33 user nova-compute[74278]:       <nova:ports>
Oct 30 10:56:33 user nova-compute[74278]:         <nova:port uuid="ef16226b-834e-4b0a-943c-52883de41281">
Oct 30 10:56:33 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 10:56:33 user nova-compute[74278]:         </nova:port>
Oct 30 10:56:33 user nova-compute[74278]:       </nova:ports>
Oct 30 10:56:33 user nova-compute[74278]:     </nova:instance>
Oct 30 10:56:33 user nova-compute[74278]:   </metadata>
Oct 30 10:56:33 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:56:33 user nova-compute[74278]:     <system>
Oct 30 10:56:33 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:56:33 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:56:33 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:56:33 user nova-compute[74278]:       <entry name="serial">5ed94499-397a-4dc4-94da-13eb67312572</entry>
Oct 30 10:56:33 user nova-compute[74278]:       <entry name="uuid">5ed94499-397a-4dc4-94da-13eb67312572</entry>
Oct 30 10:56:33 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:56:33 user nova-compute[74278]:     </system>
Oct 30 10:56:33 user nova-compute[74278]:   </sysinfo>
Oct 30 10:56:33 user nova-compute[74278]:   <os>
Oct 30 10:56:33 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:56:33 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:56:33 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:56:33 user nova-compute[74278]:   </os>
Oct 30 10:56:33 user nova-compute[74278]:   <features>
Oct 30 10:56:33 user nova-compute[74278]:     <acpi/>
Oct 30 10:56:33 user nova-compute[74278]:     <apic/>
Oct 30 10:56:33 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:56:33 user nova-compute[74278]:   </features>
Oct 30 10:56:33 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:56:33 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:56:33 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:56:33 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:56:33 user nova-compute[74278]:   </clock>
Oct 30 10:56:33 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:56:33 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:56:33 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:56:33 user nova-compute[74278]:   </cpu>
Oct 30 10:56:33 user nova-compute[74278]:   <devices>
Oct 30 10:56:33 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:56:33 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:56:33 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk"/>
Oct 30 10:56:33 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:56:33 user nova-compute[74278]:     </disk>
Oct 30 10:56:33 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:56:33 user nova-compute[74278]:       <mac address="fa:16:3e:c1:06:31"/>
Oct 30 10:56:33 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:56:33 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:56:33 user nova-compute[74278]:       <target dev="tapef16226b-83"/>
Oct 30 10:56:33 user nova-compute[74278]:     </interface>
Oct 30 10:56:33 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:56:33 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/console.log" append="off"/>
Oct 30 10:56:33 user nova-compute[74278]:     </serial>
Oct 30 10:56:33 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:56:33 user nova-compute[74278]:     <video>
Oct 30 10:56:33 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:56:33 user nova-compute[74278]:     </video>
Oct 30 10:56:33 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:56:33 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:56:33 user nova-compute[74278]:     </rng>
Oct 30 10:56:33 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:56:33 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:56:33 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:56:33 user nova-compute[74278]:     </memballoon>
Oct 30 10:56:33 user nova-compute[74278]:   </devices>
Oct 30 10:56:33 user nova-compute[74278]: </domain>
Oct 30 10:56:33 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1536753473',display_name='tempest-TestVolumeSwap-server-1536753473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1536753473',id=17,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+dePl6Ki4ZbKbxlHbk3A0QwrN0pxGBfQoZMksM0hCq6dTV7CGNKGX/SSy2+zPmzFQDp8bGih2K2zmMFxuMlN5hwfsFGHeMRTXRB3UGR2x03LtIauQLKdOf6WXuyVD3qA==',key_name='tempest-keypair-1714170783',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='396392292c2446ceaec276ff74a110b7',ramdisk_id='',reservation_id='r-0nro4n3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1555628441',owner_user_name='tempest-TestVolumeSwap-1555628441-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40af50ade2ae4f15821cb93bc8bb8fb6',uuid=5ed94499-397a-4dc4-94da-13eb67312572,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef16226b-834e-4b0a-943c-52883de41281", "address": "fa:16:3e:c1:06:31", "network": {"id": "810116c1-412d-4c6d-b69a-a2f8855639bc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1852542095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396392292c2446ceaec276ff74a110b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef16226b-83", "ovs_interfaceid": "ef16226b-834e-4b0a-943c-52883de41281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Converting VIF {"id": "ef16226b-834e-4b0a-943c-52883de41281", "address": "fa:16:3e:c1:06:31", "network": {"id": "810116c1-412d-4c6d-b69a-a2f8855639bc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1852542095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396392292c2446ceaec276ff74a110b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef16226b-83", "ovs_interfaceid": "ef16226b-834e-4b0a-943c-52883de41281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:06:31,bridge_name='br-int',has_traffic_filtering=True,id=ef16226b-834e-4b0a-943c-52883de41281,network=Network(810116c1-412d-4c6d-b69a-a2f8855639bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef16226b-83') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG os_vif [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:06:31,bridge_name='br-int',has_traffic_filtering=True,id=ef16226b-834e-4b0a-943c-52883de41281,network=Network(810116c1-412d-4c6d-b69a-a2f8855639bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef16226b-83') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd69d7a3-5df8-5f57-91bc-3d8ed3971c80', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef16226b-83, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef16226b-83, col_values=(('qos', UUID('1500c700-d39e-4bd9-b93c-6ee49b88e6e2')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef16226b-83, col_values=(('external_ids', {'iface-id': 'ef16226b-834e-4b0a-943c-52883de41281', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:06:31', 'vm-uuid': '5ed94499-397a-4dc4-94da-13eb67312572'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:33 user nova-compute[74278]: INFO os_vif [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:06:31,bridge_name='br-int',has_traffic_filtering=True,id=ef16226b-834e-4b0a-943c-52883de41281,network=Network(810116c1-412d-4c6d-b69a-a2f8855639bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef16226b-83')
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] No VIF found with MAC fa:16:3e:c1:06:31, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:56:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:34 user nova-compute[74278]: DEBUG nova.network.neutron [req-deed0b4c-f2e9-4055-8672-e0f0272d2cfe req-5309acd6-10f2-43a8-9070-54417343d71e service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Updated VIF entry in instance network info cache for port ef16226b-834e-4b0a-943c-52883de41281. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:56:34 user nova-compute[74278]: DEBUG nova.network.neutron [req-deed0b4c-f2e9-4055-8672-e0f0272d2cfe req-5309acd6-10f2-43a8-9070-54417343d71e service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Updating instance_info_cache with network_info: [{"id": "ef16226b-834e-4b0a-943c-52883de41281", "address": "fa:16:3e:c1:06:31", "network": {"id": "810116c1-412d-4c6d-b69a-a2f8855639bc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1852542095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396392292c2446ceaec276ff74a110b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef16226b-83", "ovs_interfaceid": "ef16226b-834e-4b0a-943c-52883de41281", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-deed0b4c-f2e9-4055-8672-e0f0272d2cfe req-5309acd6-10f2-43a8-9070-54417343d71e service nova] Releasing lock "refresh_cache-5ed94499-397a-4dc4-94da-13eb67312572" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:56:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:35 user nova-compute[74278]: DEBUG nova.network.neutron [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Port 346d37bb-4749-43ab-b83e-c0472def78b2 binding to destination host user is already ACTIVE {{(pid=74278) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 30 10:56:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquired lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:35 user nova-compute[74278]: DEBUG nova.network.neutron [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-2ac52dcf-71b3-48e4-9553-82082b4dca20 req-08e4774f-a2f2-4199-aa62-fc423ed20f66 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Received event network-vif-plugged-ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2ac52dcf-71b3-48e4-9553-82082b4dca20 req-08e4774f-a2f2-4199-aa62-fc423ed20f66 service nova] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2ac52dcf-71b3-48e4-9553-82082b4dca20 req-08e4774f-a2f2-4199-aa62-fc423ed20f66 service nova] Lock "5ed94499-397a-4dc4-94da-13eb67312572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2ac52dcf-71b3-48e4-9553-82082b4dca20 req-08e4774f-a2f2-4199-aa62-fc423ed20f66 service nova] Lock "5ed94499-397a-4dc4-94da-13eb67312572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-2ac52dcf-71b3-48e4-9553-82082b4dca20 req-08e4774f-a2f2-4199-aa62-fc423ed20f66 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] No waiting events found dispatching network-vif-plugged-ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:56:36 user nova-compute[74278]: WARNING nova.compute.manager [req-2ac52dcf-71b3-48e4-9553-82082b4dca20 req-08e4774f-a2f2-4199-aa62-fc423ed20f66 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Received unexpected event network-vif-plugged-ef16226b-834e-4b0a-943c-52883de41281 for instance with vm_state building and task_state spawning.
Oct 30 10:56:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG nova.network.neutron [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating instance_info_cache with network_info: [{"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Releasing lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Creating tmpfile /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/tmpglf6ikvb to verify with other compute node that the instance is on the same shared storage. {{(pid=74278) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:37 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Instance destroyed successfully.
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.objects.instance [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lazy-loading 'resources' on Instance uuid 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1697547587',display_name='tempest-ServerActionsTestOtherB-server-1697547587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1697547587',id=4,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxtrS9IHVw9VJCYjUF6eDWBKHwb7bFWD3A669NQggiEpEfM7XQnDLYLkziVDxGhK2ctlm9Mx1VSfhVfRehAdJNYHfhfvjHZCeNc+QL1vrbZckvK1AnRE3E7SPpnRLWh5Q==',key_name='tempest-keypair-979570287',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a59c309805c1416793e76777407ef388',ramdisk_id='',reservation_id='r-f0ytqg1f',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1708015848',owner_user_name='tempest-ServerActionsTestOtherB-1708015848-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:55:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7002e346bd664217af927725af208c54',uuid=25c5ad55-f85b-4371-8bdf-95a6a0f4d73d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converting VIF {"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_vif [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap346d37bb-47, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=547e2434-6a4b-4652-b388-2b0719cc73ad) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:37 user nova-compute[74278]: INFO os_vif [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47')
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxUyZTWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:56:37 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[652b23af-9b54-4631-9077-1ad7b4192734]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:56:37 user nova-compute[74278]: No targets found.
Oct 30 10:56:37 user nova-compute[74278]: iSNS:
Oct 30 10:56:37 user nova-compute[74278]: No targets found.
Oct 30 10:56:37 user nova-compute[74278]: STATIC:
Oct 30 10:56:37 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c
Oct 30 10:56:37 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:56:37 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:56:37 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1
Oct 30 10:56:37 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:56:37 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:56:37 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:56:37 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:56:37 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:56:37 user nova-compute[74278]: FIRMWARE:
Oct 30 10:56:37 user nova-compute[74278]: No targets found.
Oct 30 10:56:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:56:37 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:56:37 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf32533-748b-4adc-ab0a-d19479f0f91d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db35db7-0f11-4175-ac1c-c504d653014f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:56:37 user nova-compute[74278]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:56:37 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:56:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:56:37 user nova-compute[74278]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:56:37 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:56:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac2f43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d175af-f9ed-4e11-b0cc-9f4d2094e8c7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf7e33a-4b79-4870-9880-f31f48f8c808]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d28695a-f259-4ee3-8617-94197674d4c4]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[92afd778-d67a-4a75-8b03-ac74e0b23691]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[00408c18-1fa7-4e20-a862-9c6ab895b5ec]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaac8eee-eb0a-48eb-8884-9c94aabf0e2b]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260]
Oct 30 10:56:37 user nova-compute[74278]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260] successful.
Oct 30 10:56:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2d610f-3c54-46a8-9739-e4ef966575d7]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] <== disconnect_volume: return (392ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:56:37 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Instance spawned successfully.
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:56:37 user nova-compute[74278]: INFO nova.compute.manager [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Took 6.34 seconds to spawn the instance on the hypervisor.
Oct 30 10:56:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:56:38 user nova-compute[74278]: INFO nova.compute.manager [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Took 7.43 seconds to build instance.
Oct 30 10:56:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ff7b1ac-b022-4afe-84e9-0a849f63515a tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "5ed94499-397a-4dc4-94da-13eb67312572" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.546s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG nova.compute.manager [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Received event network-vif-plugged-ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] Lock "5ed94499-397a-4dc4-94da-13eb67312572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] Lock "5ed94499-397a-4dc4-94da-13eb67312572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG nova.compute.manager [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] No waiting events found dispatching network-vif-plugged-ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:56:38 user nova-compute[74278]: WARNING nova.compute.manager [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Received unexpected event network-vif-plugged-ef16226b-834e-4b0a-943c-52883de41281 for instance with vm_state active and task_state None.
Oct 30 10:56:38 user nova-compute[74278]: DEBUG nova.compute.manager [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-unplugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG nova.compute.manager [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] No waiting events found dispatching network-vif-unplugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:56:38 user nova-compute[74278]: WARNING nova.compute.manager [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received unexpected event network-vif-unplugged-346d37bb-4749-43ab-b83e-c0472def78b2 for instance with vm_state resized and task_state resize_reverting.
Oct 30 10:56:38 user nova-compute[74278]: DEBUG nova.compute.manager [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG nova.compute.manager [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] No waiting events found dispatching network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:56:38 user nova-compute[74278]: WARNING nova.compute.manager [req-3ed13a78-44c3-4ae5-8a94-5e9af23cbc57 req-34336dd6-8a3c-4943-86b3-0f1bf1494651 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received unexpected event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 for instance with vm_state resized and task_state resize_reverting.
Oct 30 10:56:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG nova.objects.instance [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lazy-loading 'migration_context' on Instance uuid 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG nova.objects.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Object Instance<25c5ad55-f85b-4371-8bdf-95a6a0f4d73d> lazy-loaded attributes: resources,migration_context {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:56:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:39 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:56:39 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:56:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.650s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:39 user nova-compute[74278]: INFO nova.compute.manager [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Swapping old allocation on dict_keys(['ce405684-67ab-45d9-bc83-6af4903bfb15']) held by migration 8227d4a9-05b8-4c9a-8e51-bdff91fa8bdf for instance
Oct 30 10:56:39 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Overwriting current allocation {'allocations': {'ce405684-67ab-45d9-bc83-6af4903bfb15': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': 'a59c309805c1416793e76777407ef388', 'user_id': '7002e346bd664217af927725af208c54', 'consumer_generation': 1} on consumer 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d {{(pid=74278) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 30 10:56:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquired lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:40 user nova-compute[74278]: DEBUG nova.network.neutron [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG nova.network.neutron [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating instance_info_cache with network_info: [{"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Releasing lock "refresh_cache-25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG os_brick.utils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53ff413-5cd5-47df-afcb-e2688de07205]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba49e50-72e6-467a-8a76-1acdc8d329a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b680d1fa-f543-4b64-848f-ab56f18e3351]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1111822-eb5f-490b-89a6-02e562634f4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:56:41 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:56:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2b66a5-41dd-4b6c-9618-16ad2a373580]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:56:41 user nova-compute[74278]: DEBUG os_brick.utils [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:56:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:56:44 user nova-compute[74278]: WARNING nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Oct 30 10:56:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid da67673a-dbe6-419f-8547-5ca730f14003 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 55cf7cd9-4e0b-4caa-874e-4963079e3b10 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 84448e30-982f-4214-a61e-8cc5e122aef3 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 21d2a8cc-39ee-435e-9936-d1585a9386b7 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 2591f731-03b7-49b6-93af-c5b63e505127 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 9cba7c39-a2d1-44c0-a866-01c22a3f3634 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid b5d47df1-5569-433d-bf6a-42b5e04196fa {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 5ed94499-397a-4dc4-94da-13eb67312572 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "da67673a-dbe6-419f-8547-5ca730f14003" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "da67673a-dbe6-419f-8547-5ca730f14003" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:44 user nova-compute[74278]: INFO nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "84448e30-982f-4214-a61e-8cc5e122aef3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "84448e30-982f-4214-a61e-8cc5e122aef3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "2591f731-03b7-49b6-93af-c5b63e505127" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "b5d47df1-5569-433d-bf6a-42b5e04196fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "5ed94499-397a-4dc4-94da-13eb67312572" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "da67673a-dbe6-419f-8547-5ca730f14003" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "2591f731-03b7-49b6-93af-c5b63e505127" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "84448e30-982f-4214-a61e-8cc5e122aef3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "5ed94499-397a-4dc4-94da-13eb67312572" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "b5d47df1-5569-433d-bf6a-42b5e04196fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:45 user nova-compute[74278]: INFO nova.compute.manager [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Terminating instance
Oct 30 10:56:45 user nova-compute[74278]: DEBUG nova.compute.manager [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG nova.compute.manager [req-8da5e98d-f598-4016-8e18-d993528eab46 req-6542c77f-f244-4387-957c-91ea19056b44 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Received event network-vif-unplugged-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8da5e98d-f598-4016-8e18-d993528eab46 req-6542c77f-f244-4387-957c-91ea19056b44 service nova] Acquiring lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8da5e98d-f598-4016-8e18-d993528eab46 req-6542c77f-f244-4387-957c-91ea19056b44 service nova] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8da5e98d-f598-4016-8e18-d993528eab46 req-6542c77f-f244-4387-957c-91ea19056b44 service nova] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG nova.compute.manager [req-8da5e98d-f598-4016-8e18-d993528eab46 req-6542c77f-f244-4387-957c-91ea19056b44 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] No waiting events found dispatching network-vif-unplugged-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG nova.compute.manager [req-8da5e98d-f598-4016-8e18-d993528eab46 req-6542c77f-f244-4387-957c-91ea19056b44 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Received event network-vif-unplugged-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:46 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Instance destroyed successfully.
Oct 30 10:56:46 user nova-compute[74278]: DEBUG nova.objects.instance [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lazy-loading 'resources' on Instance uuid b5d47df1-5569-433d-bf6a-42b5e04196fa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-437004539',display_name='tempest-VolumesAdminNegativeTest-server-437004539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-437004539',id=16,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02150e63eb6442ecaf9377edc9036949',ramdisk_id='',reservation_id='r-tyblzwm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-358317095',owner_user_name='tempest-VolumesAdminNegativeTest-358317095-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:54:45Z,user_data=None,user_id='3d00cea0f58247448d911d841ef601d2',uuid=b5d47df1-5569-433d-bf6a-42b5e04196fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "address": "fa:16:3e:f4:b6:68", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc4c9e5-40", "ovs_interfaceid": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Converting VIF {"id": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "address": "fa:16:3e:f4:b6:68", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapddc4c9e5-40", "ovs_interfaceid": "ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc4c9e5-40') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG os_vif [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc4c9e5-40') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapddc4c9e5-40, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=491b786f-63f4-4bb3-8114-89c468f8ef06) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:46 user nova-compute[74278]: INFO os_vif [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b6:68,bridge_name='br-int',has_traffic_filtering=True,id=ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapddc4c9e5-40')
Oct 30 10:56:46 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Deleting instance files /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa_del
Oct 30 10:56:46 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Deletion of /opt/stack/data/nova/instances/b5d47df1-5569-433d-bf6a-42b5e04196fa_del complete
Oct 30 10:56:46 user nova-compute[74278]: INFO nova.compute.manager [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 30 10:56:46 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:56:46 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:47 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Took 0.60 seconds to deallocate network for instance.
Oct 30 10:56:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-544bd1b1-3940-40bf-b806-4f8efc3c30fc req-4903022e-dd2a-4673-b751-a8ff69e36117 service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Received event network-vif-deleted-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "84448e30-982f-4214-a61e-8cc5e122aef3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "84448e30-982f-4214-a61e-8cc5e122aef3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:47 user nova-compute[74278]: INFO nova.compute.manager [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Terminating instance
Oct 30 10:56:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:47 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Deleted allocations for instance b5d47df1-5569-433d-bf6a-42b5e04196fa
Oct 30 10:56:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-70519a25-95de-4b25-a96c-a418fcf6a5e2 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.446s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-38332ed2-8f50-473a-87e6-28fc89f66369 req-087445db-2327-4289-9576-faffe65e52fb service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Received event network-vif-plugged-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-38332ed2-8f50-473a-87e6-28fc89f66369 req-087445db-2327-4289-9576-faffe65e52fb service nova] Acquiring lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-38332ed2-8f50-473a-87e6-28fc89f66369 req-087445db-2327-4289-9576-faffe65e52fb service nova] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-38332ed2-8f50-473a-87e6-28fc89f66369 req-087445db-2327-4289-9576-faffe65e52fb service nova] Lock "b5d47df1-5569-433d-bf6a-42b5e04196fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-38332ed2-8f50-473a-87e6-28fc89f66369 req-087445db-2327-4289-9576-faffe65e52fb service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] No waiting events found dispatching network-vif-plugged-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:56:47 user nova-compute[74278]: WARNING nova.compute.manager [req-38332ed2-8f50-473a-87e6-28fc89f66369 req-087445db-2327-4289-9576-faffe65e52fb service nova] [instance: b5d47df1-5569-433d-bf6a-42b5e04196fa] Received unexpected event network-vif-plugged-ddc4c9e5-405f-4ff2-b8a8-341f9f7f408f for instance with vm_state deleted and task_state None.
Oct 30 10:56:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-137a4d6d-49f0-4d63-a489-d32eafafc2aa req-3413492c-6bbb-4d8a-9609-475d1125ca3a service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Received event network-vif-unplugged-be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-137a4d6d-49f0-4d63-a489-d32eafafc2aa req-3413492c-6bbb-4d8a-9609-475d1125ca3a service nova] Acquiring lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-137a4d6d-49f0-4d63-a489-d32eafafc2aa req-3413492c-6bbb-4d8a-9609-475d1125ca3a service nova] Lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-137a4d6d-49f0-4d63-a489-d32eafafc2aa req-3413492c-6bbb-4d8a-9609-475d1125ca3a service nova] Lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-137a4d6d-49f0-4d63-a489-d32eafafc2aa req-3413492c-6bbb-4d8a-9609-475d1125ca3a service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] No waiting events found dispatching network-vif-unplugged-be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:56:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-137a4d6d-49f0-4d63-a489-d32eafafc2aa req-3413492c-6bbb-4d8a-9609-475d1125ca3a service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Received event network-vif-unplugged-be704baf-2542-497e-af45-bffa287fc1cd for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:56:48 user nova-compute[74278]: INFO nova.compute.claims [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Claim successful on node user
Oct 30 10:56:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Instance destroyed successfully.
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.objects.instance [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'resources' on Instance uuid 84448e30-982f-4214-a61e-8cc5e122aef3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1397790136',display_name='tempest-AttachVolumeNegativeTest-server-1397790136',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1397790136',id=5,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlqP0t8QpmrNP/69xD3v1rWPdWuTwaxXsGGjDgIlhcIChX1IaSevGhhO0+C7HTcBvTquT5PC1j7YKyF2o6wPbODsbubB6OU0CJ9itw28tASMyjK5G223srJk+oVx5zWvw==',key_name='tempest-keypair-1464136291',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:50:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b43bf73deda348f08290daf640768705',ramdisk_id='',reservation_id='r-4xbez1up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-871157650',owner_user_name='tempest-AttachVolumeNegativeTest-871157650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31e7e6847ec0415fba0fd909c014e802',uuid=84448e30-982f-4214-a61e-8cc5e122aef3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be704baf-2542-497e-af45-bffa287fc1cd", "address": "fa:16:3e:27:25:f0", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe704baf-25", "ovs_interfaceid": "be704baf-2542-497e-af45-bffa287fc1cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converting VIF {"id": "be704baf-2542-497e-af45-bffa287fc1cd", "address": "fa:16:3e:27:25:f0", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe704baf-25", "ovs_interfaceid": "be704baf-2542-497e-af45-bffa287fc1cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:25:f0,bridge_name='br-int',has_traffic_filtering=True,id=be704baf-2542-497e-af45-bffa287fc1cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe704baf-25') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG os_vif [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:25:f0,bridge_name='br-int',has_traffic_filtering=True,id=be704baf-2542-497e-af45-bffa287fc1cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe704baf-25') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe704baf-25, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d21e30c1-611c-4df9-8c59-2302a84b9da8) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:48 user nova-compute[74278]: INFO os_vif [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:25:f0,bridge_name='br-int',has_traffic_filtering=True,id=be704baf-2542-497e-af45-bffa287fc1cd,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe704baf-25')
Oct 30 10:56:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Deleting instance files /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3_del
Oct 30 10:56:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Deletion of /opt/stack/data/nova/instances/84448e30-982f-4214-a61e-8cc5e122aef3_del complete
Oct 30 10:56:48 user nova-compute[74278]: INFO nova.compute.manager [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 30 10:56:48 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:56:48 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:56:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:56:49 user nova-compute[74278]: DEBUG nova.compute.manager [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:56:49 user nova-compute[74278]: INFO nova.virt.block_device [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Booting with volume b566a64a-aadb-4270-8fe4-b3599498df80 at /dev/vda
Oct 30 10:56:49 user nova-compute[74278]: DEBUG os_brick.utils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2827dc-fb1f-48e4-9ade-84d175ede4d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9431259-b32a-4b70-854f-7a67b32d6612]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddd2ca4-15bd-42b8-b290-c0b886f0bf49]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[77516684-8e74-4eaf-b6f6-579c3960e9c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG nova.policy [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ab29f4448114abc9456799a794b6b57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a202f3c5f6c422e91e843f803dc142c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:56:49 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:56:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ac17be-8b6b-47ba-b3d4-9aed83476572]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG os_brick.utils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:56:49 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating existing volume attachment record: c9dbcd0c-a9da-455e-bc3d-993c3b41cd30 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:56:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-214f614a-30f7-41db-8f93-96da8ffa8545 req-994547c7-3cbc-4c8b-9afc-c6db5a5090a3 service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Received event network-vif-plugged-be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-214f614a-30f7-41db-8f93-96da8ffa8545 req-994547c7-3cbc-4c8b-9afc-c6db5a5090a3 service nova] Acquiring lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-214f614a-30f7-41db-8f93-96da8ffa8545 req-994547c7-3cbc-4c8b-9afc-c6db5a5090a3 service nova] Lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-214f614a-30f7-41db-8f93-96da8ffa8545 req-994547c7-3cbc-4c8b-9afc-c6db5a5090a3 service nova] Lock "84448e30-982f-4214-a61e-8cc5e122aef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-214f614a-30f7-41db-8f93-96da8ffa8545 req-994547c7-3cbc-4c8b-9afc-c6db5a5090a3 service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] No waiting events found dispatching network-vif-plugged-be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:56:50 user nova-compute[74278]: WARNING nova.compute.manager [req-214f614a-30f7-41db-8f93-96da8ffa8545 req-994547c7-3cbc-4c8b-9afc-c6db5a5090a3 service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Received unexpected event network-vif-plugged-be704baf-2542-497e-af45-bffa287fc1cd for instance with vm_state active and task_state deleting.
Oct 30 10:56:50 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:50 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Took 1.61 seconds to deallocate network for instance.
Oct 30 10:56:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-7d8e48f2-d2e1-4e48-bb39-bd07cf402a85 req-b0bf8efa-d4ac-4834-9590-690ca17e89e3 service nova] [instance: 84448e30-982f-4214-a61e-8cc5e122aef3] Received event network-vif-deleted-be704baf-2542-497e-af45-bffa287fc1cd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:56:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:56:50 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Successfully created port: d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:56:50 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:56:50 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:56:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:50 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Deleted allocations for instance 84448e30-982f-4214-a61e-8cc5e122aef3
Oct 30 10:56:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d5933638-a322-4f3b-8a8e-e87a34f67717 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "84448e30-982f-4214-a61e-8cc5e122aef3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.380s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:56:51 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Successfully created port: b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:56:51 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Successfully created port: 0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:56:52 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Successfully created port: e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:56:52 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Successfully created port: e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:56:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:53 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Successfully updated port: d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:56:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-e575ff8e-196a-4701-b79b-31b877b26e59 req-18a07c5a-b645-49dc-94b6-0682ad4b8a7d service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-changed-d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-e575ff8e-196a-4701-b79b-31b877b26e59 req-18a07c5a-b645-49dc-94b6-0682ad4b8a7d service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing instance network info cache due to event network-changed-d300f067-441e-4d3b-a83a-f7eddbcb58fc. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:56:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e575ff8e-196a-4701-b79b-31b877b26e59 req-18a07c5a-b645-49dc-94b6-0682ad4b8a7d service nova] Acquiring lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e575ff8e-196a-4701-b79b-31b877b26e59 req-18a07c5a-b645-49dc-94b6-0682ad4b8a7d service nova] Acquired lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:53 user nova-compute[74278]: DEBUG nova.network.neutron [req-e575ff8e-196a-4701-b79b-31b877b26e59 req-18a07c5a-b645-49dc-94b6-0682ad4b8a7d service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing network info cache for port d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:56:53 user nova-compute[74278]: DEBUG nova.network.neutron [req-e575ff8e-196a-4701-b79b-31b877b26e59 req-18a07c5a-b645-49dc-94b6-0682ad4b8a7d service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:56:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:54 user nova-compute[74278]: DEBUG nova.network.neutron [req-e575ff8e-196a-4701-b79b-31b877b26e59 req-18a07c5a-b645-49dc-94b6-0682ad4b8a7d service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e575ff8e-196a-4701-b79b-31b877b26e59 req-18a07c5a-b645-49dc-94b6-0682ad4b8a7d service nova] Releasing lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:56:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Successfully updated port: 645e6816-b45e-455b-b558-039baf08d79a {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:56:55 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Successfully updated port: 487a7419-c1b7-4d9f-81a0-b52e76795926 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:56:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-changed-645e6816-b45e-455b-b558-039baf08d79a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing instance network info cache due to event network-changed-645e6816-b45e-455b-b558-039baf08d79a. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:56:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] Acquiring lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] Acquired lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing network info cache for port 645e6816-b45e-455b-b558-039baf08d79a {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:56:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:56:56 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Successfully updated port: b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:56:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] Releasing lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:56:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-changed-487a7419-c1b7-4d9f-81a0-b52e76795926 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing instance network info cache due to event network-changed-487a7419-c1b7-4d9f-81a0-b52e76795926. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:56:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] Acquiring lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] Acquired lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing network info cache for port 487a7419-c1b7-4d9f-81a0-b52e76795926 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:56:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:56:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-07f19a33-2d7a-4455-84f6-5fe9a4cb90c0 req-6bc7d6d9-9d94-4b90-83ae-320d3f511ef6 service nova] Releasing lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:56:57 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Successfully updated port: 0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:56:57 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Successfully updated port: e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:56:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-changed-b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing instance network info cache due to event network-changed-b92be7d7-88bb-45e4-b5b8-94d127ad295f. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:56:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] Acquiring lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] Acquired lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:57 user nova-compute[74278]: DEBUG nova.network.neutron [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing network info cache for port b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG nova.network.neutron [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG nova.network.neutron [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] Releasing lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-changed-0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing instance network info cache due to event network-changed-0d26599a-8ac3-408a-b67c-d1d9041e3d72. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] Acquiring lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] Acquired lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG nova.network.neutron [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing network info cache for port 0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG nova.network.neutron [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG nova.network.neutron [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] Releasing lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-changed-e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing instance network info cache due to event network-changed-e90182c7-f21f-4f96-88de-46c9272e577e. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] Acquiring lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] Acquired lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG nova.network.neutron [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing network info cache for port e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG nova.network.neutron [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:56:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:56:59 user nova-compute[74278]: DEBUG nova.network.neutron [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:56:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Successfully updated port: e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:56:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-10f21a93-1f55-47ac-8909-c24bd5522eeb req-823a5c48-8393-4d46-866f-01d3c1b44071 service nova] Releasing lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:56:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:56:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquired lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:56:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:56:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:57:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-ab9613f7-9162-46ec-937e-a3fa271a6266 req-c5c29e3d-798a-4866-835f-505a5d2ba46e service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-changed-e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-ab9613f7-9162-46ec-937e-a3fa271a6266 req-c5c29e3d-798a-4866-835f-505a5d2ba46e service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing instance network info cache due to event network-changed-e898cb36-b040-4316-b0e2-9d6af4724592. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:57:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ab9613f7-9162-46ec-937e-a3fa271a6266 req-c5c29e3d-798a-4866-835f-505a5d2ba46e service nova] Acquiring lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:57:01 user nova-compute[74278]: DEBUG nova.network.neutron [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating instance_info_cache with network_info: [{"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "address": "fa:16:3e:85:da:01", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d26599a-8a", "ovs_interfaceid": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e898cb36-b040-4316-b0e2-9d6af4724592", "address": "fa:16:3e:f7:70:58", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape898cb36-b0", "ovs_interfaceid": "e898cb36-b040-4316-b0e2-9d6af4724592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:57:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Releasing lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:57:01 user nova-compute[74278]: DEBUG nova.compute.manager [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Instance network_info: |[{"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "address": "fa:16:3e:85:da:01", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d26599a-8a", "ovs_interfaceid": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e898cb36-b040-4316-b0e2-9d6af4724592", "address": "fa:16:3e:f7:70:58", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape898cb36-b0", "ovs_interfaceid": "e898cb36-b040-4316-b0e2-9d6af4724592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:57:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ab9613f7-9162-46ec-937e-a3fa271a6266 req-c5c29e3d-798a-4866-835f-505a5d2ba46e service nova] Acquired lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:57:01 user nova-compute[74278]: DEBUG nova.network.neutron [req-ab9613f7-9162-46ec-937e-a3fa271a6266 req-c5c29e3d-798a-4866-835f-505a5d2ba46e service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing network info cache for port e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:57:01 user nova-compute[74278]: DEBUG nova.network.neutron [req-ab9613f7-9162-46ec-937e-a3fa271a6266 req-c5c29e3d-798a-4866-835f-505a5d2ba46e service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updated VIF entry in instance network info cache for port e898cb36-b040-4316-b0e2-9d6af4724592. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:57:01 user nova-compute[74278]: DEBUG nova.network.neutron [req-ab9613f7-9162-46ec-937e-a3fa271a6266 req-c5c29e3d-798a-4866-835f-505a5d2ba46e service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating instance_info_cache with network_info: [{"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "address": "fa:16:3e:85:da:01", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d26599a-8a", "ovs_interfaceid": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e898cb36-b040-4316-b0e2-9d6af4724592", "address": "fa:16:3e:f7:70:58", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape898cb36-b0", "ovs_interfaceid": "e898cb36-b040-4316-b0e2-9d6af4724592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:57:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ab9613f7-9162-46ec-937e-a3fa271a6266 req-c5c29e3d-798a-4866-835f-505a5d2ba46e service nova] Releasing lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IQNpSqZR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:57:02 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:57:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:57:02 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:57:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:57:02 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[033f30fc-0fd3-4bb3-99a1-58b9be78e11a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:57:02 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0cd1d4-4d7e-46f5-b7c6-09aa55155817]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1] added
Oct 30 10:57:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[31919cdc-836b-4010-a527-98428a48d8ed]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[582a6cd0-4b44-4a92-9a8a-744e7de972a1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IQNpSqZR {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IQNpSqZR" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc86b305-9e92-4425-ae9b-e9702a2fefc2]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IQNpSqZR'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc744fa1-c8ef-4cbe-8b1c-462c9e1bf0fa]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[702e7fe2-844a-41e5-8dda-7bff3b6917d5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:57:03 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:57:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:57:03 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:57:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ba132e-81c4-42a1-b101-ccbca28e53b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1, portal: 172.16.0.220,3260]
Oct 30 10:57:03 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1, portal: 172.16.0.220,3260] successful.
Oct 30 10:57:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ffadb7-3cff-4292-addf-da610672d091]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a132c79f-7630-4b2c-88f5-09340bcc2567]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:57:03 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:57:03 user nova-compute[74278]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 (non-flash)
Oct 30 10:57:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:57:03 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:57:03 user nova-compute[74278]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 (non-flash)
Oct 30 10:57:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9f9dd8-389f-41c0-96c1-a8cde4ce715e]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Starting finish_revert_migration {{(pid=74278) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Start _get_guest_xml network_info=[{"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxUyZTWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '25c5ad55-f85b-4371-8bdf-95a6a0f4d73d', 'attached_at': '2023-10-30T10:57:04.000000', 'detached_at': '', 'volume_id': 'e0066f51-c274-4eea-9f0c-8acdcded086c', 'serial': 'e0066f51-c274-4eea-9f0c-8acdcded086c'}, 'attachment_id': 'dc47e435-cfce-4987-952a-a0d9154d7338', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:57:03 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:57:03 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:57:03 user nova-compute[74278]: DEBUG nova.objects.instance [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxUyZTWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:57:04 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IQNpSqZR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23033303732303463', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033303732303463', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.180s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:57:04 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:57:04 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lazy-loading 'flavor' on Instance uuid 9cba7c39-a2d1-44c0-a866-01c22a3f3634 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8c3e4a-e020-4192-a77c-0bb9b8d80e4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:57:04 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 10:57:04 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:57:04 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 10:57:04 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:57:04 user nova-compute[74278]:   <serial>e0e4421e-6f87-40ec-9095-9810114767e1</serial>
Oct 30 10:57:04 user nova-compute[74278]: </disk>
Oct 30 10:57:04 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2730711b-79ba-4d76-85b9-87a6e0422c24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c] added
Oct 30 10:57:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eaf39c-bc9e-4f19-b26f-b5daccdfa57a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a6ce2-d7c8-4fca-ba8d-1e54bd531807]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxUyZTWd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxUyZTWd" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afd3aca-2e4d-410a-b511-e3cfb8b9e1ea]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FxUyZTWd'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce55733f-5091-44fb-bf31-896696fd46ea]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[71432b5b-7a28-4322-9f68-88a99549cbf0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:57:04 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:57:04 user nova-compute[74278]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 (non-flash)
Oct 30 10:57:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:57:04 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:57:04 user nova-compute[74278]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 (non-flash)
Oct 30 10:57:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7d730c-3c21-42aa-b89c-22c0078b86c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260]
Oct 30 10:57:04 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260] successful.
Oct 30 10:57:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3c2710-8421-4456-92ee-2f6a31ba85d2]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72bf05d-7604-4544-b949-fc4542ed001c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:57:04 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:57:04 user nova-compute[74278]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 (non-flash)
Oct 30 10:57:04 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:57:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:57:04 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:57:04 user nova-compute[74278]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 (non-flash)
Oct 30 10:57:04 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:57:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[470ede1e-5a96-41cd-8067-de5b49f66440]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] No VIF found with MAC fa:16:3e:0d:b7:d3, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:57:04 user nova-compute[74278]: INFO nova.compute.manager [None req-7ff9a435-2c55-4fd3-a319-c6e73c80f075 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Unrescuing
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7ff9a435-2c55-4fd3-a319-c6e73c80f075 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7ff9a435-2c55-4fd3-a319-c6e73c80f075 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquired lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG nova.network.neutron [None req-7ff9a435-2c55-4fd3-a319-c6e73c80f075 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-839ff165-3458-4eb0-b4a5-b042cce0f22d tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.098s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 20.655s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG nova.network.neutron [None req-7ff9a435-2c55-4fd3-a319-c6e73c80f075 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Updating instance_info_cache with network_info: [{"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7ff9a435-2c55-4fd3-a319-c6e73c80f075 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Releasing lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG nova.objects.instance [None req-7ff9a435-2c55-4fd3-a319-c6e73c80f075 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'flavor' on Instance uuid 2591f731-03b7-49b6-93af-c5b63e505127 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxUyZTWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] <== connect_volume: return (1553ms) {'type': 'block', 'scsi_wwn': '26133663466313931', 'path': '/dev/sdd'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133663466313931', 'path': '/dev/sdd'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1697547587',display_name='tempest-ServerActionsTestOtherB-server-1697547587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1697547587',id=4,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxtrS9IHVw9VJCYjUF6eDWBKHwb7bFWD3A669NQggiEpEfM7XQnDLYLkziVDxGhK2ctlm9Mx1VSfhVfRehAdJNYHfhfvjHZCeNc+QL1vrbZckvK1AnRE3E7SPpnRLWh5Q==',key_name='tempest-keypair-979570287',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a59c309805c1416793e76777407ef388',ramdisk_id='',reservation_id='r-f0ytqg1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1708015848',owner_user_name='tempest-ServerActionsTestOtherB-1708015848-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:56:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7002e346bd664217af927725af208c54',uuid=25c5ad55-f85b-4371-8bdf-95a6a0f4d73d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converting VIF {"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:57:05 user nova-compute[74278]:   <uuid>25c5ad55-f85b-4371-8bdf-95a6a0f4d73d</uuid>
Oct 30 10:57:05 user nova-compute[74278]:   <name>instance-00000004</name>
Oct 30 10:57:05 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:57:05 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:57:05 user nova-compute[74278]:   <metadata>
Oct 30 10:57:05 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:57:05 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:57:05 user nova-compute[74278]:       <nova:name>tempest-ServerActionsTestOtherB-server-1697547587</nova:name>
Oct 30 10:57:05 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:57:03</nova:creationTime>
Oct 30 10:57:05 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:57:05 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:57:05 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:57:05 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:57:05 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:57:05 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:57:05 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:57:05 user nova-compute[74278]:       <nova:owner>
Oct 30 10:57:05 user nova-compute[74278]:         <nova:user uuid="7002e346bd664217af927725af208c54">tempest-ServerActionsTestOtherB-1708015848-project-member</nova:user>
Oct 30 10:57:05 user nova-compute[74278]:         <nova:project uuid="a59c309805c1416793e76777407ef388">tempest-ServerActionsTestOtherB-1708015848</nova:project>
Oct 30 10:57:05 user nova-compute[74278]:       </nova:owner>
Oct 30 10:57:05 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:57:05 user nova-compute[74278]:       <nova:ports>
Oct 30 10:57:05 user nova-compute[74278]:         <nova:port uuid="346d37bb-4749-43ab-b83e-c0472def78b2">
Oct 30 10:57:05 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 10:57:05 user nova-compute[74278]:         </nova:port>
Oct 30 10:57:05 user nova-compute[74278]:       </nova:ports>
Oct 30 10:57:05 user nova-compute[74278]:     </nova:instance>
Oct 30 10:57:05 user nova-compute[74278]:   </metadata>
Oct 30 10:57:05 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:57:05 user nova-compute[74278]:     <system>
Oct 30 10:57:05 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:57:05 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:57:05 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:57:05 user nova-compute[74278]:       <entry name="serial">25c5ad55-f85b-4371-8bdf-95a6a0f4d73d</entry>
Oct 30 10:57:05 user nova-compute[74278]:       <entry name="uuid">25c5ad55-f85b-4371-8bdf-95a6a0f4d73d</entry>
Oct 30 10:57:05 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:57:05 user nova-compute[74278]:     </system>
Oct 30 10:57:05 user nova-compute[74278]:   </sysinfo>
Oct 30 10:57:05 user nova-compute[74278]:   <os>
Oct 30 10:57:05 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:57:05 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:57:05 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:57:05 user nova-compute[74278]:   </os>
Oct 30 10:57:05 user nova-compute[74278]:   <features>
Oct 30 10:57:05 user nova-compute[74278]:     <acpi/>
Oct 30 10:57:05 user nova-compute[74278]:     <apic/>
Oct 30 10:57:05 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:57:05 user nova-compute[74278]:   </features>
Oct 30 10:57:05 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:57:05 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:57:05 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:57:05 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:57:05 user nova-compute[74278]:   </clock>
Oct 30 10:57:05 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:57:05 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:57:05 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:57:05 user nova-compute[74278]:   </cpu>
Oct 30 10:57:05 user nova-compute[74278]:   <devices>
Oct 30 10:57:05 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:57:05 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:57:05 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk"/>
Oct 30 10:57:05 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:57:05 user nova-compute[74278]:     </disk>
Oct 30 10:57:05 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 10:57:05 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:57:05 user nova-compute[74278]:       <source dev="/dev/sdd"/>
Oct 30 10:57:05 user nova-compute[74278]:       <target dev="vdb" bus="virtio"/>
Oct 30 10:57:05 user nova-compute[74278]:       <serial>e0066f51-c274-4eea-9f0c-8acdcded086c</serial>
Oct 30 10:57:05 user nova-compute[74278]:     </disk>
Oct 30 10:57:05 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:57:05 user nova-compute[74278]:       <mac address="fa:16:3e:8b:ee:5f"/>
Oct 30 10:57:05 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:57:05 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:57:05 user nova-compute[74278]:       <target dev="tap346d37bb-47"/>
Oct 30 10:57:05 user nova-compute[74278]:     </interface>
Oct 30 10:57:05 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:57:05 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/console.log" append="off"/>
Oct 30 10:57:05 user nova-compute[74278]:     </serial>
Oct 30 10:57:05 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:57:05 user nova-compute[74278]:     <video>
Oct 30 10:57:05 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:57:05 user nova-compute[74278]:     </video>
Oct 30 10:57:05 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:57:05 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:57:05 user nova-compute[74278]:     </rng>
Oct 30 10:57:05 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:57:05 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:57:05 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:57:05 user nova-compute[74278]:     </memballoon>
Oct 30 10:57:05 user nova-compute[74278]:   </devices>
Oct 30 10:57:05 user nova-compute[74278]: </domain>
Oct 30 10:57:05 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1697547587',display_name='tempest-ServerActionsTestOtherB-server-1697547587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1697547587',id=4,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxtrS9IHVw9VJCYjUF6eDWBKHwb7bFWD3A669NQggiEpEfM7XQnDLYLkziVDxGhK2ctlm9Mx1VSfhVfRehAdJNYHfhfvjHZCeNc+QL1vrbZckvK1AnRE3E7SPpnRLWh5Q==',key_name='tempest-keypair-979570287',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a59c309805c1416793e76777407ef388',ramdisk_id='',reservation_id='r-f0ytqg1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1708015848',owner_user_name='tempest-ServerActionsTestOtherB-1708015848-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:56:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7002e346bd664217af927725af208c54',uuid=25c5ad55-f85b-4371-8bdf-95a6a0f4d73d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converting VIF {"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG os_vif [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8c1aa7a-a83b-53c9-bfbd-11924bfc616d', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap346d37bb-47, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap346d37bb-47, col_values=(('qos', UUID('889f4783-401c-4930-a0e3-d709e2a05291')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap346d37bb-47, col_values=(('external_ids', {'iface-id': '346d37bb-4749-43ab-b83e-c0472def78b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:ee:5f', 'vm-uuid': '25c5ad55-f85b-4371-8bdf-95a6a0f4d73d'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-35ff2350-3836-45be-a534-872850436d74 req-1df2289c-b916-42b5-b7f9-44ae430f4f28 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-unplugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-35ff2350-3836-45be-a534-872850436d74 req-1df2289c-b916-42b5-b7f9-44ae430f4f28 service nova] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-35ff2350-3836-45be-a534-872850436d74 req-1df2289c-b916-42b5-b7f9-44ae430f4f28 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-35ff2350-3836-45be-a534-872850436d74 req-1df2289c-b916-42b5-b7f9-44ae430f4f28 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-35ff2350-3836-45be-a534-872850436d74 req-1df2289c-b916-42b5-b7f9-44ae430f4f28 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] No waiting events found dispatching network-vif-unplugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:57:05 user nova-compute[74278]: WARNING nova.compute.manager [req-35ff2350-3836-45be-a534-872850436d74 req-1df2289c-b916-42b5-b7f9-44ae430f4f28 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received unexpected event network-vif-unplugged-f8d17d66-8240-41ca-855d-531672079adb for instance with vm_state rescued and task_state unrescuing.
Oct 30 10:57:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:05 user nova-compute[74278]: INFO os_vif [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47')
Oct 30 10:57:06 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Instance destroyed successfully.
Oct 30 10:57:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:07 user nova-compute[74278]: INFO nova.compute.manager [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Detaching volume e0e4421e-6f87-40ec-9095-9810114767e1
Oct 30 10:57:07 user nova-compute[74278]: INFO nova.virt.block_device [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Attempting to driver detach volume e0e4421e-6f87-40ec-9095-9810114767e1 from mountpoint /dev/vdb
Oct 30 10:57:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Attempting to detach device vdb from instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 10:57:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 10:57:07 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:57:07 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 10:57:07 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:57:07 user nova-compute[74278]:   <serial>e0e4421e-6f87-40ec-9095-9810114767e1</serial>
Oct 30 10:57:07 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 10:57:07 user nova-compute[74278]: </disk>
Oct 30 10:57:07 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:57:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Successfully detached device vdb from instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 from the persistent domain config.
Oct 30 10:57:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 10:57:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 10:57:07 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:57:07 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 10:57:07 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:57:07 user nova-compute[74278]:   <serial>e0e4421e-6f87-40ec-9095-9810114767e1</serial>
Oct 30 10:57:07 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 10:57:07 user nova-compute[74278]: </disk>
Oct 30 10:57:07 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 10:57:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-c6b3a55f-b88e-4213-bd83-c3d58e6fa544 req-9e3ab53a-640c-48f3-9cdb-9e62dba88d43 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c6b3a55f-b88e-4213-bd83-c3d58e6fa544 req-9e3ab53a-640c-48f3-9cdb-9e62dba88d43 service nova] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c6b3a55f-b88e-4213-bd83-c3d58e6fa544 req-9e3ab53a-640c-48f3-9cdb-9e62dba88d43 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c6b3a55f-b88e-4213-bd83-c3d58e6fa544 req-9e3ab53a-640c-48f3-9cdb-9e62dba88d43 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-c6b3a55f-b88e-4213-bd83-c3d58e6fa544 req-9e3ab53a-640c-48f3-9cdb-9e62dba88d43 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] No waiting events found dispatching network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:57:07 user nova-compute[74278]: WARNING nova.compute.manager [req-c6b3a55f-b88e-4213-bd83-c3d58e6fa544 req-9e3ab53a-640c-48f3-9cdb-9e62dba88d43 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received unexpected event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb for instance with vm_state rescued and task_state unrescuing.
Oct 30 10:57:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 10:57:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] No waiting events found dispatching network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:57:09 user nova-compute[74278]: WARNING nova.compute.manager [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received unexpected event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 for instance with vm_state resized and task_state resize_reverting.
Oct 30 10:57:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] No waiting events found dispatching network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:57:09 user nova-compute[74278]: WARNING nova.compute.manager [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received unexpected event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 for instance with vm_state resized and task_state resize_reverting.
Oct 30 10:57:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] No waiting events found dispatching network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:57:09 user nova-compute[74278]: WARNING nova.compute.manager [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received unexpected event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb for instance with vm_state rescued and task_state unrescuing.
Oct 30 10:57:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] No waiting events found dispatching network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:57:09 user nova-compute[74278]: WARNING nova.compute.manager [req-110c4ec7-06e5-4acc-974c-d5dc2d57c592 req-596048a7-d7ce-4cbe-9972-e750217145b0 service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received unexpected event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb for instance with vm_state rescued and task_state unrescuing.
Oct 30 10:57:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:11 user nova-compute[74278]: INFO nova.virt.block_device [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Booting with volume f0b5fa84-3517-4e41-999f-b8cfb51e56d9 at /dev/vdb
Oct 30 10:57:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-7ff9a435-2c55-4fd3-a319-c6e73c80f075 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:57:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:57:11 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Instance running successfully.
Oct 30 10:57:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] finish_revert_migration finished successfully. {{(pid=74278) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG os_brick.utils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cddbfeb-cfce-4efc-ac5a-1ef208e9d2df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9739ab-6fd1-43e3-91fb-208d096c4b3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8c7a3c-8696-42e7-99e8-b3c570015fc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[22993baf-2f3b-462a-9831-44de21057060]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:57:12 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:57:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07f1a8f-b4a9-43fa-9e33-03fddf7b0944]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG os_brick.utils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:57:12 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating existing volume attachment record: 36830ba7-ecdd-4756-831a-1d1d0e628052 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:57:12 user nova-compute[74278]: INFO nova.compute.manager [None req-58c191dc-e7b8-4a67-bd0c-7353d57b8712 tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating instance to original state: 'active'
Oct 30 10:57:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:20 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:57:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:21 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:57:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:57:21 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:57:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:21 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:57:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:57:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "65466a3f-2824-4172-a3c2-8fba650788e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "65466a3f-2824-4172-a3c2-8fba650788e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:57:23 user nova-compute[74278]: INFO nova.compute.claims [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Claim successful on node user
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:57:24 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:57:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:24 user nova-compute[74278]: DEBUG nova.policy [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b9a38bd9c4e4717b9499ed404ed2d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8215346d10443799d5d450114b09386', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:57:25 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Creating image(s)
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "/opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "/opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "/opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:25 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:57:25 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7874MB free_disk=25.18244171142578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 55cf7cd9-4e0b-4caa-874e-4963079e3b10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 21d2a8cc-39ee-435e-9936-d1585a9386b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 5ed94499-397a-4dc4-94da-13eb67312572 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance f5fec1d4-833e-44db-8226-795fd62b18d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.198s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk 1073741824" returned: 0 in 0.070s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.249s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Successfully created port: 2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.889s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Cannot resize image /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Ensure instance console log exists: /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Successfully updated port: 2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquired lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-531f8b3d-16ca-4355-a62e-ad8cddeaaec0 req-cf80510a-f8b7-4c0b-893c-5d40d2869a63 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received event network-changed-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-531f8b3d-16ca-4355-a62e-ad8cddeaaec0 req-cf80510a-f8b7-4c0b-893c-5d40d2869a63 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Refreshing instance network info cache due to event network-changed-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-531f8b3d-16ca-4355-a62e-ad8cddeaaec0 req-cf80510a-f8b7-4c0b-893c-5d40d2869a63 service nova] Acquiring lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updating instance_info_cache with network_info: [{"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Releasing lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Instance network_info: |[{"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-531f8b3d-16ca-4355-a62e-ad8cddeaaec0 req-cf80510a-f8b7-4c0b-893c-5d40d2869a63 service nova] Acquired lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.network.neutron [req-531f8b3d-16ca-4355-a62e-ad8cddeaaec0 req-cf80510a-f8b7-4c0b-893c-5d40d2869a63 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Refreshing network info cache for port 2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Start _get_guest_xml network_info=[{"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:57:26 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:57:26 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:57:26 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:57:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:57:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-792826486',display_name='tempest-ServerActionsTestOtherA-server-792826486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-792826486',id=19,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+yfE1fzC0NeFR+gspIaPJ/CcDdqYlrTD1/gMueYz50h0LQsw5TCBiSQS0P2divdfLo9Fj2hNvf4LMgeazslsUbDPOdzcoch9KTxV2Qpnb5QJ+Ahxn1Nm/kcqA+i5KG3A==',key_name='tempest-keypair-148099064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-rlmf0hdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:57:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=65466a3f-2824-4172-a3c2-8fba650788e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b94215b-9b') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.objects.instance [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lazy-loading 'pci_devices' on Instance uuid 65466a3f-2824-4172-a3c2-8fba650788e9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:57:27 user nova-compute[74278]:   <uuid>65466a3f-2824-4172-a3c2-8fba650788e9</uuid>
Oct 30 10:57:27 user nova-compute[74278]:   <name>instance-00000013</name>
Oct 30 10:57:27 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:57:27 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:57:27 user nova-compute[74278]:   <metadata>
Oct 30 10:57:27 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:57:27 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:57:27 user nova-compute[74278]:       <nova:name>tempest-ServerActionsTestOtherA-server-792826486</nova:name>
Oct 30 10:57:27 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:57:26</nova:creationTime>
Oct 30 10:57:27 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:57:27 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:57:27 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:57:27 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:57:27 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:57:27 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:57:27 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:57:27 user nova-compute[74278]:       <nova:owner>
Oct 30 10:57:27 user nova-compute[74278]:         <nova:user uuid="1b9a38bd9c4e4717b9499ed404ed2d6d">tempest-ServerActionsTestOtherA-1217247754-project-member</nova:user>
Oct 30 10:57:27 user nova-compute[74278]:         <nova:project uuid="d8215346d10443799d5d450114b09386">tempest-ServerActionsTestOtherA-1217247754</nova:project>
Oct 30 10:57:27 user nova-compute[74278]:       </nova:owner>
Oct 30 10:57:27 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:57:27 user nova-compute[74278]:       <nova:ports>
Oct 30 10:57:27 user nova-compute[74278]:         <nova:port uuid="2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4">
Oct 30 10:57:27 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 10:57:27 user nova-compute[74278]:         </nova:port>
Oct 30 10:57:27 user nova-compute[74278]:       </nova:ports>
Oct 30 10:57:27 user nova-compute[74278]:     </nova:instance>
Oct 30 10:57:27 user nova-compute[74278]:   </metadata>
Oct 30 10:57:27 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:57:27 user nova-compute[74278]:     <system>
Oct 30 10:57:27 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:57:27 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:57:27 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:57:27 user nova-compute[74278]:       <entry name="serial">65466a3f-2824-4172-a3c2-8fba650788e9</entry>
Oct 30 10:57:27 user nova-compute[74278]:       <entry name="uuid">65466a3f-2824-4172-a3c2-8fba650788e9</entry>
Oct 30 10:57:27 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:57:27 user nova-compute[74278]:     </system>
Oct 30 10:57:27 user nova-compute[74278]:   </sysinfo>
Oct 30 10:57:27 user nova-compute[74278]:   <os>
Oct 30 10:57:27 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:57:27 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:57:27 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:57:27 user nova-compute[74278]:   </os>
Oct 30 10:57:27 user nova-compute[74278]:   <features>
Oct 30 10:57:27 user nova-compute[74278]:     <acpi/>
Oct 30 10:57:27 user nova-compute[74278]:     <apic/>
Oct 30 10:57:27 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:57:27 user nova-compute[74278]:   </features>
Oct 30 10:57:27 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:57:27 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:57:27 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:57:27 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:57:27 user nova-compute[74278]:   </clock>
Oct 30 10:57:27 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:57:27 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:57:27 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:57:27 user nova-compute[74278]:   </cpu>
Oct 30 10:57:27 user nova-compute[74278]:   <devices>
Oct 30 10:57:27 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:57:27 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:57:27 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk"/>
Oct 30 10:57:27 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:57:27 user nova-compute[74278]:     </disk>
Oct 30 10:57:27 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:57:27 user nova-compute[74278]:       <mac address="fa:16:3e:6a:72:fc"/>
Oct 30 10:57:27 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:57:27 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:57:27 user nova-compute[74278]:       <target dev="tap2b94215b-9b"/>
Oct 30 10:57:27 user nova-compute[74278]:     </interface>
Oct 30 10:57:27 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:57:27 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/console.log" append="off"/>
Oct 30 10:57:27 user nova-compute[74278]:     </serial>
Oct 30 10:57:27 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:57:27 user nova-compute[74278]:     <video>
Oct 30 10:57:27 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:57:27 user nova-compute[74278]:     </video>
Oct 30 10:57:27 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:57:27 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:57:27 user nova-compute[74278]:     </rng>
Oct 30 10:57:27 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:57:27 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:57:27 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:57:27 user nova-compute[74278]:     </memballoon>
Oct 30 10:57:27 user nova-compute[74278]:   </devices>
Oct 30 10:57:27 user nova-compute[74278]: </domain>
Oct 30 10:57:27 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:57:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-792826486',display_name='tempest-ServerActionsTestOtherA-server-792826486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-792826486',id=19,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+yfE1fzC0NeFR+gspIaPJ/CcDdqYlrTD1/gMueYz50h0LQsw5TCBiSQS0P2divdfLo9Fj2hNvf4LMgeazslsUbDPOdzcoch9KTxV2Qpnb5QJ+Ahxn1Nm/kcqA+i5KG3A==',key_name='tempest-keypair-148099064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-rlmf0hdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:57:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=65466a3f-2824-4172-a3c2-8fba650788e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b94215b-9b') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG os_vif [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b94215b-9b') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '265f4e8e-a9e1-5e18-9cbd-3b8f91be3ead', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Didn't find any instances for network info cache update. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b94215b-9b, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b94215b-9b, col_values=(('qos', UUID('169aff13-bc08-4630-b52b-1440cb92018a')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b94215b-9b, col_values=(('external_ids', {'iface-id': '2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:72:fc', 'vm-uuid': '65466a3f-2824-4172-a3c2-8fba650788e9'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:27 user nova-compute[74278]: INFO os_vif [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b94215b-9b')
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No VIF found with MAC fa:16:3e:6a:72:fc, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.network.neutron [req-531f8b3d-16ca-4355-a62e-ad8cddeaaec0 req-cf80510a-f8b7-4c0b-893c-5d40d2869a63 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updated VIF entry in instance network info cache for port 2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.network.neutron [req-531f8b3d-16ca-4355-a62e-ad8cddeaaec0 req-cf80510a-f8b7-4c0b-893c-5d40d2869a63 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updating instance_info_cache with network_info: [{"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-531f8b3d-16ca-4355-a62e-ad8cddeaaec0 req-cf80510a-f8b7-4c0b-893c-5d40d2869a63 service nova] Releasing lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:57:27 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 is timed out.
Oct 30 10:57:27 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Successfully detached device vdb from instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 from the live domain config.
Oct 30 10:57:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IQNpSqZR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:57:27 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:57:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b614cd89-ae7f-4de1-ad37-43125ace8636]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:57:27 user nova-compute[74278]: No targets found.
Oct 30 10:57:27 user nova-compute[74278]: iSNS:
Oct 30 10:57:27 user nova-compute[74278]: No targets found.
Oct 30 10:57:27 user nova-compute[74278]: STATIC:
Oct 30 10:57:27 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c
Oct 30 10:57:27 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:57:27 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:57:27 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1
Oct 30 10:57:27 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:57:27 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:57:27 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:57:27 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:57:27 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:57:27 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1
Oct 30 10:57:27 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:57:27 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:57:27 user nova-compute[74278]: FIRMWARE:
Oct 30 10:57:27 user nova-compute[74278]: No targets found.
Oct 30 10:57:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:57:27 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:57:27 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8937326b-fe2a-4212-a656-3b0031330e75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4272b75-1fe9-497f-aa2a-766abaffd1e6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:57:27 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:57:27 user nova-compute[74278]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 (non-flash)
Oct 30 10:57:27 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:57:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:57:27 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:57:27 user nova-compute[74278]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 (non-flash)
Oct 30 10:57:27 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:57:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac13c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:57:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[88542c0b-ddcc-49db-bd80-2b22c9ccf835]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebefab81-72f8-495d-9fdb-9c0674e03f2e]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eb02a2-b7b0-429e-b61f-a4c957b07d5f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f685455-ca0c-4020-a1b3-5e0256057a19]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e990ce5-8acc-43fe-b37a-c736db26b049]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b097fe-eb36-427c-9473-7d775b60c1b7]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1, portal: 172.16.0.220,3260]
Oct 30 10:57:28 user nova-compute[74278]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1, portal: 172.16.0.220,3260] successful.
Oct 30 10:57:28 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0e4421e-6f87-40ec-9095-9810114767e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd3cddf-63aa-4f6f-8486-cc8f807d4542]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] <== disconnect_volume: return (340ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-e271b550-464c-43c3-860b-b6e971609c81 req-88b5f9b4-cbba-4a30-b59e-22f7870dc114 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received event network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e271b550-464c-43c3-860b-b6e971609c81 req-88b5f9b4-cbba-4a30-b59e-22f7870dc114 service nova] Acquiring lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e271b550-464c-43c3-860b-b6e971609c81 req-88b5f9b4-cbba-4a30-b59e-22f7870dc114 service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e271b550-464c-43c3-860b-b6e971609c81 req-88b5f9b4-cbba-4a30-b59e-22f7870dc114 service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-e271b550-464c-43c3-860b-b6e971609c81 req-88b5f9b4-cbba-4a30-b59e-22f7870dc114 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] No waiting events found dispatching network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:57:28 user nova-compute[74278]: WARNING nova.compute.manager [req-e271b550-464c-43c3-860b-b6e971609c81 req-88b5f9b4-cbba-4a30-b59e-22f7870dc114 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received unexpected event network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 for instance with vm_state building and task_state spawning.
Oct 30 10:57:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:57:30 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Instance spawned successfully.
Oct 30 10:57:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-8a47f244-5c79-4b09-b351-9e48c90d1fec req-5fb83fba-135f-4e1b-b468-bab44ae456b0 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received event network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8a47f244-5c79-4b09-b351-9e48c90d1fec req-5fb83fba-135f-4e1b-b468-bab44ae456b0 service nova] Acquiring lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8a47f244-5c79-4b09-b351-9e48c90d1fec req-5fb83fba-135f-4e1b-b468-bab44ae456b0 service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8a47f244-5c79-4b09-b351-9e48c90d1fec req-5fb83fba-135f-4e1b-b468-bab44ae456b0 service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-8a47f244-5c79-4b09-b351-9e48c90d1fec req-5fb83fba-135f-4e1b-b468-bab44ae456b0 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] No waiting events found dispatching network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:57:30 user nova-compute[74278]: WARNING nova.compute.manager [req-8a47f244-5c79-4b09-b351-9e48c90d1fec req-5fb83fba-135f-4e1b-b468-bab44ae456b0 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received unexpected event network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 for instance with vm_state building and task_state spawning.
Oct 30 10:57:30 user nova-compute[74278]: INFO nova.compute.manager [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Took 5.95 seconds to spawn the instance on the hypervisor.
Oct 30 10:57:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:57:31 user nova-compute[74278]: INFO nova.compute.manager [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Took 7.43 seconds to build instance.
Oct 30 10:57:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c3167b33-7cc6-4dda-870b-4fd7f68c1587 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "65466a3f-2824-4172-a3c2-8fba650788e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.633s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG nova.objects.instance [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lazy-loading 'flavor' on Instance uuid 9cba7c39-a2d1-44c0-a866-01c22a3f3634 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c52fd636-6d08-47d7-bcde-715f14b56152 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.272s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:36 user nova-compute[74278]: INFO nova.virt.block_device [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Booting with volume 51111d83-06f8-4619-83bc-ada1b2363b39 at /dev/vdc
Oct 30 10:57:36 user nova-compute[74278]: DEBUG os_brick.utils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfea802-1595-4cec-b408-09d6aca52820]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[131d1ee5-89ae-4dcc-bc28-bf7bbde6f098]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b720db-9714-4285-9b18-8d03b316177b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02f6671-1c50-4c83-b376-3fc5e97d18cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:57:36 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:57:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9abddf-9d16-422f-8390-64388855de85]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG os_brick.utils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:57:36 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating existing volume attachment record: 4b7c6618-35cd-432a-bd15-fdcb939f02b7 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:57:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:57:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:41 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:57:41 user nova-compute[74278]: INFO nova.compute.claims [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Claim successful on node user
Oct 30 10:57:42 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:57:42 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:57:42 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG nova.policy [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31e7e6847ec0415fba0fd909c014e802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43bf73deda348f08290daf640768705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:57:42 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Creating image(s)
Oct 30 10:57:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "/opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "/opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.235s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.171s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk 1073741824" returned: 0 in 0.056s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.201s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Successfully created port: f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Cannot resize image /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Ensure instance console log exists: /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Successfully updated port: f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "refresh_cache-d6bdec9e-b5dc-483d-b89e-ece814c92e42" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquired lock "refresh_cache-d6bdec9e-b5dc-483d-b89e-ece814c92e42" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-334a5224-956e-4652-9167-779d33f5ea46 req-3ff5c5e1-cd96-443a-b267-9c4d5e1999e3 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Received event network-changed-f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-334a5224-956e-4652-9167-779d33f5ea46 req-3ff5c5e1-cd96-443a-b267-9c4d5e1999e3 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Refreshing instance network info cache due to event network-changed-f98897ed-9d97-41d1-8bd0-257b57595656. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-334a5224-956e-4652-9167-779d33f5ea46 req-3ff5c5e1-cd96-443a-b267-9c4d5e1999e3 service nova] Acquiring lock "refresh_cache-d6bdec9e-b5dc-483d-b89e-ece814c92e42" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Updating instance_info_cache with network_info: [{"id": "f98897ed-9d97-41d1-8bd0-257b57595656", "address": "fa:16:3e:fd:9f:c7", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98897ed-9d", "ovs_interfaceid": "f98897ed-9d97-41d1-8bd0-257b57595656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Releasing lock "refresh_cache-d6bdec9e-b5dc-483d-b89e-ece814c92e42" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Instance network_info: |[{"id": "f98897ed-9d97-41d1-8bd0-257b57595656", "address": "fa:16:3e:fd:9f:c7", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98897ed-9d", "ovs_interfaceid": "f98897ed-9d97-41d1-8bd0-257b57595656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-334a5224-956e-4652-9167-779d33f5ea46 req-3ff5c5e1-cd96-443a-b267-9c4d5e1999e3 service nova] Acquired lock "refresh_cache-d6bdec9e-b5dc-483d-b89e-ece814c92e42" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-334a5224-956e-4652-9167-779d33f5ea46 req-3ff5c5e1-cd96-443a-b267-9c4d5e1999e3 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Refreshing network info cache for port f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Start _get_guest_xml network_info=[{"id": "f98897ed-9d97-41d1-8bd0-257b57595656", "address": "fa:16:3e:fd:9f:c7", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98897ed-9d", "ovs_interfaceid": "f98897ed-9d97-41d1-8bd0-257b57595656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:57:44 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:57:44 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:57:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1928451537',display_name='tempest-AttachVolumeNegativeTest-server-1928451537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1928451537',id=20,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhoClxba5SCRA1AmJJIPxhIU7zPrOriyWA3wGV4hIA2SZIBnu84WPcOQf4W0uPLo+veRP/M3X2e02WEJtnpxQ3dpfvJoI/nUjXSx7T3uChqJmhBdzHR1x2IVRD9n9uWlw==',key_name='tempest-keypair-1742881020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43bf73deda348f08290daf640768705',ramdisk_id='',reservation_id='r-i8vl8zol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-871157650',owner_user_name='tempest-AttachVolumeNegativeTest-871157650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:57:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31e7e6847ec0415fba0fd909c014e802',uuid=d6bdec9e-b5dc-483d-b89e-ece814c92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f98897ed-9d97-41d1-8bd0-257b57595656", "address": "fa:16:3e:fd:9f:c7", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98897ed-9d", "ovs_interfaceid": "f98897ed-9d97-41d1-8bd0-257b57595656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converting VIF {"id": "f98897ed-9d97-41d1-8bd0-257b57595656", "address": "fa:16:3e:fd:9f:c7", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98897ed-9d", "ovs_interfaceid": "f98897ed-9d97-41d1-8bd0-257b57595656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=f98897ed-9d97-41d1-8bd0-257b57595656,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98897ed-9d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.objects.instance [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'pci_devices' on Instance uuid d6bdec9e-b5dc-483d-b89e-ece814c92e42 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:57:44 user nova-compute[74278]:   <uuid>d6bdec9e-b5dc-483d-b89e-ece814c92e42</uuid>
Oct 30 10:57:44 user nova-compute[74278]:   <name>instance-00000014</name>
Oct 30 10:57:44 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:57:44 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:57:44 user nova-compute[74278]:   <metadata>
Oct 30 10:57:44 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:57:44 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:57:44 user nova-compute[74278]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1928451537</nova:name>
Oct 30 10:57:44 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:57:44</nova:creationTime>
Oct 30 10:57:44 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:57:44 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:57:44 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:57:44 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:57:44 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:57:44 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:57:44 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:57:44 user nova-compute[74278]:       <nova:owner>
Oct 30 10:57:44 user nova-compute[74278]:         <nova:user uuid="31e7e6847ec0415fba0fd909c014e802">tempest-AttachVolumeNegativeTest-871157650-project-member</nova:user>
Oct 30 10:57:44 user nova-compute[74278]:         <nova:project uuid="b43bf73deda348f08290daf640768705">tempest-AttachVolumeNegativeTest-871157650</nova:project>
Oct 30 10:57:44 user nova-compute[74278]:       </nova:owner>
Oct 30 10:57:44 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:57:44 user nova-compute[74278]:       <nova:ports>
Oct 30 10:57:44 user nova-compute[74278]:         <nova:port uuid="f98897ed-9d97-41d1-8bd0-257b57595656">
Oct 30 10:57:44 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 10:57:44 user nova-compute[74278]:         </nova:port>
Oct 30 10:57:44 user nova-compute[74278]:       </nova:ports>
Oct 30 10:57:44 user nova-compute[74278]:     </nova:instance>
Oct 30 10:57:44 user nova-compute[74278]:   </metadata>
Oct 30 10:57:44 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:57:44 user nova-compute[74278]:     <system>
Oct 30 10:57:44 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:57:44 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:57:44 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:57:44 user nova-compute[74278]:       <entry name="serial">d6bdec9e-b5dc-483d-b89e-ece814c92e42</entry>
Oct 30 10:57:44 user nova-compute[74278]:       <entry name="uuid">d6bdec9e-b5dc-483d-b89e-ece814c92e42</entry>
Oct 30 10:57:44 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:57:44 user nova-compute[74278]:     </system>
Oct 30 10:57:44 user nova-compute[74278]:   </sysinfo>
Oct 30 10:57:44 user nova-compute[74278]:   <os>
Oct 30 10:57:44 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:57:44 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:57:44 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:57:44 user nova-compute[74278]:   </os>
Oct 30 10:57:44 user nova-compute[74278]:   <features>
Oct 30 10:57:44 user nova-compute[74278]:     <acpi/>
Oct 30 10:57:44 user nova-compute[74278]:     <apic/>
Oct 30 10:57:44 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:57:44 user nova-compute[74278]:   </features>
Oct 30 10:57:44 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:57:44 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:57:44 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:57:44 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:57:44 user nova-compute[74278]:   </clock>
Oct 30 10:57:44 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:57:44 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:57:44 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:57:44 user nova-compute[74278]:   </cpu>
Oct 30 10:57:44 user nova-compute[74278]:   <devices>
Oct 30 10:57:44 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:57:44 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:57:44 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk"/>
Oct 30 10:57:44 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:57:44 user nova-compute[74278]:     </disk>
Oct 30 10:57:44 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:57:44 user nova-compute[74278]:       <mac address="fa:16:3e:fd:9f:c7"/>
Oct 30 10:57:44 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:57:44 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:57:44 user nova-compute[74278]:       <target dev="tapf98897ed-9d"/>
Oct 30 10:57:44 user nova-compute[74278]:     </interface>
Oct 30 10:57:44 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:57:44 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/console.log" append="off"/>
Oct 30 10:57:44 user nova-compute[74278]:     </serial>
Oct 30 10:57:44 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:57:44 user nova-compute[74278]:     <video>
Oct 30 10:57:44 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:57:44 user nova-compute[74278]:     </video>
Oct 30 10:57:44 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:57:44 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:57:44 user nova-compute[74278]:     </rng>
Oct 30 10:57:44 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:57:44 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:57:44 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:57:44 user nova-compute[74278]:     </memballoon>
Oct 30 10:57:44 user nova-compute[74278]:   </devices>
Oct 30 10:57:44 user nova-compute[74278]: </domain>
Oct 30 10:57:44 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:57:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1928451537',display_name='tempest-AttachVolumeNegativeTest-server-1928451537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1928451537',id=20,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhoClxba5SCRA1AmJJIPxhIU7zPrOriyWA3wGV4hIA2SZIBnu84WPcOQf4W0uPLo+veRP/M3X2e02WEJtnpxQ3dpfvJoI/nUjXSx7T3uChqJmhBdzHR1x2IVRD9n9uWlw==',key_name='tempest-keypair-1742881020',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43bf73deda348f08290daf640768705',ramdisk_id='',reservation_id='r-i8vl8zol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-871157650',owner_user_name='tempest-AttachVolumeNegativeTest-871157650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:57:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31e7e6847ec0415fba0fd909c014e802',uuid=d6bdec9e-b5dc-483d-b89e-ece814c92e42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f98897ed-9d97-41d1-8bd0-257b57595656", "address": "fa:16:3e:fd:9f:c7", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98897ed-9d", "ovs_interfaceid": "f98897ed-9d97-41d1-8bd0-257b57595656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converting VIF {"id": "f98897ed-9d97-41d1-8bd0-257b57595656", "address": "fa:16:3e:fd:9f:c7", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98897ed-9d", "ovs_interfaceid": "f98897ed-9d97-41d1-8bd0-257b57595656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=f98897ed-9d97-41d1-8bd0-257b57595656,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98897ed-9d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG os_vif [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=f98897ed-9d97-41d1-8bd0-257b57595656,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98897ed-9d') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b7fc014-1935-5770-bfcd-0d385aa0bd79', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:57:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf98897ed-9d, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf98897ed-9d, col_values=(('qos', UUID('58db8ef6-08e0-4822-9120-69a27cf2b8e3')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf98897ed-9d, col_values=(('external_ids', {'iface-id': 'f98897ed-9d97-41d1-8bd0-257b57595656', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:9f:c7', 'vm-uuid': 'd6bdec9e-b5dc-483d-b89e-ece814c92e42'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:57:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:45 user nova-compute[74278]: INFO os_vif [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=f98897ed-9d97-41d1-8bd0-257b57595656,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98897ed-9d')
Oct 30 10:57:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:57:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No VIF found with MAC fa:16:3e:fd:9f:c7, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:57:45 user nova-compute[74278]: DEBUG nova.network.neutron [req-334a5224-956e-4652-9167-779d33f5ea46 req-3ff5c5e1-cd96-443a-b267-9c4d5e1999e3 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Updated VIF entry in instance network info cache for port f98897ed-9d97-41d1-8bd0-257b57595656. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:57:45 user nova-compute[74278]: DEBUG nova.network.neutron [req-334a5224-956e-4652-9167-779d33f5ea46 req-3ff5c5e1-cd96-443a-b267-9c4d5e1999e3 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Updating instance_info_cache with network_info: [{"id": "f98897ed-9d97-41d1-8bd0-257b57595656", "address": "fa:16:3e:fd:9f:c7", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98897ed-9d", "ovs_interfaceid": "f98897ed-9d97-41d1-8bd0-257b57595656", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:57:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-334a5224-956e-4652-9167-779d33f5ea46 req-3ff5c5e1-cd96-443a-b267-9c4d5e1999e3 service nova] Releasing lock "refresh_cache-d6bdec9e-b5dc-483d-b89e-ece814c92e42" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:57:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-493bef01-d03d-4964-af38-23ea7765ffe0 req-5cd7befd-965e-4ffb-8de1-035d5afeea3a service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Received event network-vif-plugged-f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-493bef01-d03d-4964-af38-23ea7765ffe0 req-5cd7befd-965e-4ffb-8de1-035d5afeea3a service nova] Acquiring lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-493bef01-d03d-4964-af38-23ea7765ffe0 req-5cd7befd-965e-4ffb-8de1-035d5afeea3a service nova] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-493bef01-d03d-4964-af38-23ea7765ffe0 req-5cd7befd-965e-4ffb-8de1-035d5afeea3a service nova] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-493bef01-d03d-4964-af38-23ea7765ffe0 req-5cd7befd-965e-4ffb-8de1-035d5afeea3a service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] No waiting events found dispatching network-vif-plugged-f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:57:46 user nova-compute[74278]: WARNING nova.compute.manager [req-493bef01-d03d-4964-af38-23ea7765ffe0 req-5cd7befd-965e-4ffb-8de1-035d5afeea3a service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Received unexpected event network-vif-plugged-f98897ed-9d97-41d1-8bd0-257b57595656 for instance with vm_state building and task_state spawning.
Oct 30 10:57:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:47 user nova-compute[74278]: INFO nova.compute.manager [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Terminating instance
Oct 30 10:57:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-f6282efe-3355-4912-a139-ef2cb1e1543e req-f9404c7f-e5f5-4585-9217-0b73d5cd4b4f service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Received event network-vif-unplugged-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f6282efe-3355-4912-a139-ef2cb1e1543e req-f9404c7f-e5f5-4585-9217-0b73d5cd4b4f service nova] Acquiring lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f6282efe-3355-4912-a139-ef2cb1e1543e req-f9404c7f-e5f5-4585-9217-0b73d5cd4b4f service nova] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f6282efe-3355-4912-a139-ef2cb1e1543e req-f9404c7f-e5f5-4585-9217-0b73d5cd4b4f service nova] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-f6282efe-3355-4912-a139-ef2cb1e1543e req-f9404c7f-e5f5-4585-9217-0b73d5cd4b4f service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] No waiting events found dispatching network-vif-unplugged-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-f6282efe-3355-4912-a139-ef2cb1e1543e req-f9404c7f-e5f5-4585-9217-0b73d5cd4b4f service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Received event network-vif-unplugged-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:57:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Instance destroyed successfully.
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.objects.instance [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lazy-loading 'resources' on Instance uuid 21d2a8cc-39ee-435e-9936-d1585a9386b7 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1476012007',display_name='tempest-VolumesAdminNegativeTest-server-1476012007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1476012007',id=6,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFahvsi9fYH2E4ZTcxa6VqxwmFrIFlj9K/5L6j9PJdKU6YuNH7VNaOxNypG8uf+70SRcFLsf4rhEhtmaPHog1v/30NV3Rk0FqXzGNA1FGl7oXbmaNuKPt0o+Ao+z++Kpg==',key_name='tempest-keypair-594939322',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:50:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02150e63eb6442ecaf9377edc9036949',ramdisk_id='',reservation_id='r-a09wx02s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-358317095',owner_user_name='tempest-VolumesAdminNegativeTest-358317095-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:50:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d00cea0f58247448d911d841ef601d2',uuid=21d2a8cc-39ee-435e-9936-d1585a9386b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "address": "fa:16:3e:d1:b8:2b", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7b9741-ec", "ovs_interfaceid": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Converting VIF {"id": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "address": "fa:16:3e:d1:b8:2b", "network": {"id": "5024708c-90e7-4e9b-a12b-13a7e850a527", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-716261239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02150e63eb6442ecaf9377edc9036949", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c7b9741-ec", "ovs_interfaceid": "6c7b9741-ec03-46ec-bc59-c3c7ad1bf369", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b8:2b,bridge_name='br-int',has_traffic_filtering=True,id=6c7b9741-ec03-46ec-bc59-c3c7ad1bf369,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7b9741-ec') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG os_vif [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b8:2b,bridge_name='br-int',has_traffic_filtering=True,id=6c7b9741-ec03-46ec-bc59-c3c7ad1bf369,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7b9741-ec') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c7b9741-ec, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e06253fd-232f-4907-81dc-d876dd90cf68) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:48 user nova-compute[74278]: INFO os_vif [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:b8:2b,bridge_name='br-int',has_traffic_filtering=True,id=6c7b9741-ec03-46ec-bc59-c3c7ad1bf369,network=Network(5024708c-90e7-4e9b-a12b-13a7e850a527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c7b9741-ec')
Oct 30 10:57:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Deleting instance files /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7_del
Oct 30 10:57:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Deletion of /opt/stack/data/nova/instances/21d2a8cc-39ee-435e-9936-d1585a9386b7_del complete
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:57:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Instance spawned successfully.
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:57:48 user nova-compute[74278]: INFO nova.compute.manager [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 30 10:57:48 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-8d3ff4df-eced-4ac7-a68a-32bc78a156bf req-d7f7eb88-632e-4823-835e-9884635409b9 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Received event network-vif-plugged-f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8d3ff4df-eced-4ac7-a68a-32bc78a156bf req-d7f7eb88-632e-4823-835e-9884635409b9 service nova] Acquiring lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8d3ff4df-eced-4ac7-a68a-32bc78a156bf req-d7f7eb88-632e-4823-835e-9884635409b9 service nova] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8d3ff4df-eced-4ac7-a68a-32bc78a156bf req-d7f7eb88-632e-4823-835e-9884635409b9 service nova] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-8d3ff4df-eced-4ac7-a68a-32bc78a156bf req-d7f7eb88-632e-4823-835e-9884635409b9 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] No waiting events found dispatching network-vif-plugged-f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:57:48 user nova-compute[74278]: WARNING nova.compute.manager [req-8d3ff4df-eced-4ac7-a68a-32bc78a156bf req-d7f7eb88-632e-4823-835e-9884635409b9 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Received unexpected event network-vif-plugged-f98897ed-9d97-41d1-8bd0-257b57595656 for instance with vm_state building and task_state spawning.
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:57:48 user nova-compute[74278]: INFO nova.compute.manager [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Took 6.36 seconds to spawn the instance on the hypervisor.
Oct 30 10:57:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:57:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:49 user nova-compute[74278]: INFO nova.compute.manager [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Took 7.46 seconds to build instance.
Oct 30 10:57:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f072b29e-b28f-4cfd-aea2-19e5998be418 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.565s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:49 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:57:49 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Took 1.06 seconds to deallocate network for instance.
Oct 30 10:57:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-4e08d271-393f-4190-8836-2fd3edafa41e req-1b9677da-8dc9-437d-bf7b-f26070614bb6 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Received event network-vif-plugged-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4e08d271-393f-4190-8836-2fd3edafa41e req-1b9677da-8dc9-437d-bf7b-f26070614bb6 service nova] Acquiring lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:57:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4e08d271-393f-4190-8836-2fd3edafa41e req-1b9677da-8dc9-437d-bf7b-f26070614bb6 service nova] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:57:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4e08d271-393f-4190-8836-2fd3edafa41e req-1b9677da-8dc9-437d-bf7b-f26070614bb6 service nova] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-4e08d271-393f-4190-8836-2fd3edafa41e req-1b9677da-8dc9-437d-bf7b-f26070614bb6 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] No waiting events found dispatching network-vif-plugged-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:57:50 user nova-compute[74278]: WARNING nova.compute.manager [req-4e08d271-393f-4190-8836-2fd3edafa41e req-1b9677da-8dc9-437d-bf7b-f26070614bb6 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Received unexpected event network-vif-plugged-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 for instance with vm_state deleted and task_state None.
Oct 30 10:57:50 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:57:50 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:57:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:50 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Deleted allocations for instance 21d2a8cc-39ee-435e-9936-d1585a9386b7
Oct 30 10:57:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-525e47ee-fa2d-4cc2-bdfb-34544c7e7833 tempest-VolumesAdminNegativeTest-358317095 tempest-VolumesAdminNegativeTest-358317095-project-member] Lock "21d2a8cc-39ee-435e-9936-d1585a9386b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.718s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:57:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-3b9a7e42-35c2-4ccc-bed0-b48949cd3d84 req-42984cb6-5dbb-4d97-9c9d-e7f706baa9b9 service nova] [instance: 21d2a8cc-39ee-435e-9936-d1585a9386b7] Received event network-vif-deleted-6c7b9741-ec03-46ec-bc59-c3c7ad1bf369 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:57:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:57:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:58:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Creating image(s)
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Ensure instance console log exists: /opt/stack/data/nova/instances/f5fec1d4-833e-44db-8226-795fd62b18d8/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Start _get_guest_xml network_info=[{"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "address": "fa:16:3e:85:da:01", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d26599a-8a", "ovs_interfaceid": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e898cb36-b040-4316-b0e2-9d6af4724592", "address": "fa:16:3e:f7:70:58", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape898cb36-b0", "ovs_interfaceid": "e898cb36-b040-4316-b0e2-9d6af4724592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGDHAbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5fec1d4-833e-44db-8226-795fd62b18d8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b566a64a-aadb-4270-8fe4-b3599498df80', 'serial': 'b566a64a-aadb-4270-8fe4-b3599498df80'}, 'attachment_id': 'c9dbcd0c-a9da-455e-bc3d-993c3b41cd30', 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDQBLtvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5fec1d4-833e-44db-8226-795fd62b18d8', 'attached_at': '', 'detached_at': '', 'volume_id': 'f0b5fa84-3517-4e41-999f-b8cfb51e56d9', 'serial': 'f0b5fa84-3517-4e41-999f-b8cfb51e56d9'}, 'attachment_id': '36830ba7-ecdd-4756-831a-1d1d0e628052', 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlCAXGnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5fec1d4-833e-44db-8226-795fd62b18d8', 'attached_at': '', 'detached_at': '', 'volume_id': '51111d83-06f8-4619-83bc-ada1b2363b39', 'serial': '51111d83-06f8-4619-83bc-ada1b2363b39'}, 'attachment_id': '4b7c6618-35cd-432a-bd15-fdcb939f02b7', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:58:00 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:58:00 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGDHAbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:58:00 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:58:00 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:58:00 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eef5a07-9f53-4ef3-8c6d-867f9357ad17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:58:00 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c71623-caf1-4456-a6c2-824219eecb90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80] added
Oct 30 10:58:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f36714b-d412-4006-a60f-a5c08d4815a2]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9da305-b502-4ef5-a930-c9a0c8af531a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGDHAbOQ {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tGDHAbOQ" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3390a2-3000-44ab-9fc5-7747105efa7e]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tGDHAbOQ'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aaa5e1-00fb-4ca7-850a-d41661ad9333]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[818e4c2c-9b52-4c89-9c47-06e43298524c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:00 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:00 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:00 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:00 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd994831-1217-40fd-9a30-b8e0fda44cea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80, portal: 172.16.0.220,3260]
Oct 30 10:58:00 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80, portal: 172.16.0.220,3260] successful.
Oct 30 10:58:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc9ca4a-81ac-4ec9-846a-35839c48a5a3]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9eac99-623c-485e-8223-0e6c16614a1d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:00 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:00 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:00 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:00 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:00 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:00 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9895c5-61f1-477f-98ec-f58ea5aa8534]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:58:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGDHAbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23836623234383738', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836623234383738', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDQBLtvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:58:01 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:58:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:58:01 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:58:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:58:01 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:58:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8599ae57-8ff9-4973-b760-a20d96c502ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:58:01 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be05693-0ab4-4a6c-83cd-bd91f6e316d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9] added
Oct 30 10:58:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[79df9c4e-c729-463f-a7a2-341a4ca04e11]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc774798-1124-45fb-92a9-27db4cf604ec]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jDQBLtvV {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jDQBLtvV" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f38e038-6c3b-41f2-8de7-4c7cfe6a0640]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jDQBLtvV'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[658b994a-4e56-4c94-ad17-36a4796b9d1a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dc0a21-2445-49ef-ae31-bd6d67a76d81]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[695cc651-9cfd-49a6-8904-4e8f635e01ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9, portal: 172.16.0.220,3260]
Oct 30 10:58:02 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9, portal: 172.16.0.220,3260] successful.
Oct 30 10:58:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6bcfa6-5e13-4133-a82d-23c4e90566ea]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[200de694-1ec8-4705-b8f3-6c366bb64d1f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bf8d29-8f70-463e-923d-3f3159d3c519]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:58:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDQBLtvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23761646432336635', 'path': '/dev/sde'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761646432336635', 'path': '/dev/sde'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlCAXGnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:58:03 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:58:03 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:58:03 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a024b3-5c58-4880-829f-ad9e3fc78032]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:58:03 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf1cd12-c837-425f-89a1-1ecd111be44f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39] added
Oct 30 10:58:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5addb1-7cd8-421a-b79b-90fc17361be5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d4fd1b-de28-4e05-b7a4-4a866538dab5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xlCAXGnE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xlCAXGnE" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7891c1d8-f485-42ef-a5b5-3b4811001366]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xlCAXGnE'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[032a3494-5be2-4805-9590-12675916f349]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a8b588-2044-4d24-8f42-e6746657da2e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc7ef47-c1c1-4a79-ad0a-e8e1c49bfc96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39, portal: 172.16.0.220,3260]
Oct 30 10:58:03 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39, portal: 172.16.0.220,3260] successful.
Oct 30 10:58:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bf2f63-8511-47a9-8c10-30442387f4fe]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[33284a2c-c5ec-4125-acce-95a77f8cd574]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:58:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3885014-d6f9-4b92-abd1-1e53001f30c7]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlCAXGnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23333396439376539', 'path': '/dev/sdg'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333396439376539', 'path': '/dev/sdg'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:fc:3d,bridge_name='br-int',has_traffic_filtering=True,id=d300f067-441e-4d3b-a83a-f7eddbcb58fc,network=Network(0f0be984-c96c-43a4-b9b1-20765fd1279a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd300f067-44') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=645e6816-b45e-455b-b558-039baf08d79a,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap645e6816-b4') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:df:d1,bridge_name='br-int',has_traffic_filtering=True,id=487a7419-c1b7-4d9f-81a0-b52e76795926,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap487a7419-c1') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:0a:29,bridge_name='br-int',has_traffic_filtering=True,id=b92be7d7-88bb-45e4-b5b8-94d127ad295f,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92be7d7-88') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "address": "fa:16:3e:85:da:01", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d26599a-8a", "ovs_interfaceid": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "address": "fa:16:3e:85:da:01", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d26599a-8a", "ovs_interfaceid": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:da:01,bridge_name='br-int',has_traffic_filtering=True,id=0d26599a-8ac3-408a-b67c-d1d9041e3d72,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d26599a-8a') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e90182c7-f21f-4f96-88de-46c9272e577e,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90182c7-f2') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e898cb36-b040-4316-b0e2-9d6af4724592", "address": "fa:16:3e:f7:70:58", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape898cb36-b0", "ovs_interfaceid": "e898cb36-b040-4316-b0e2-9d6af4724592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "e898cb36-b040-4316-b0e2-9d6af4724592", "address": "fa:16:3e:f7:70:58", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape898cb36-b0", "ovs_interfaceid": "e898cb36-b040-4316-b0e2-9d6af4724592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:70:58,bridge_name='br-int',has_traffic_filtering=True,id=e898cb36-b040-4316-b0e2-9d6af4724592,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape898cb36-b0') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lazy-loading 'pci_devices' on Instance uuid f5fec1d4-833e-44db-8226-795fd62b18d8 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:58:04 user nova-compute[74278]:   <uuid>f5fec1d4-833e-44db-8226-795fd62b18d8</uuid>
Oct 30 10:58:04 user nova-compute[74278]:   <name>instance-00000012</name>
Oct 30 10:58:04 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:58:04 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:58:04 user nova-compute[74278]:   <metadata>
Oct 30 10:58:04 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:58:04 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:58:04 user nova-compute[74278]:       <nova:name>tempest-device-tagging-server-1912409533</nova:name>
Oct 30 10:58:04 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:58:00</nova:creationTime>
Oct 30 10:58:04 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:58:04 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:58:04 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:58:04 user nova-compute[74278]:       <nova:owner>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:user uuid="6ab29f4448114abc9456799a794b6b57">tempest-TaggedBootDevicesTest_v242-993466353-project-member</nova:user>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:project uuid="2a202f3c5f6c422e91e843f803dc142c">tempest-TaggedBootDevicesTest_v242-993466353</nova:project>
Oct 30 10:58:04 user nova-compute[74278]:       </nova:owner>
Oct 30 10:58:04 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:58:04 user nova-compute[74278]:       <nova:ports>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:port uuid="d300f067-441e-4d3b-a83a-f7eddbcb58fc">
Oct 30 10:58:04 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 10:58:04 user nova-compute[74278]:         </nova:port>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:port uuid="645e6816-b45e-455b-b558-039baf08d79a">
Oct 30 10:58:04 user nova-compute[74278]:           <nova:ip type="fixed" address="10.1.1.88" ipVersion="4"/>
Oct 30 10:58:04 user nova-compute[74278]:         </nova:port>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:port uuid="487a7419-c1b7-4d9f-81a0-b52e76795926">
Oct 30 10:58:04 user nova-compute[74278]:           <nova:ip type="fixed" address="10.1.1.23" ipVersion="4"/>
Oct 30 10:58:04 user nova-compute[74278]:         </nova:port>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:port uuid="b92be7d7-88bb-45e4-b5b8-94d127ad295f">
Oct 30 10:58:04 user nova-compute[74278]:           <nova:ip type="fixed" address="10.1.1.128" ipVersion="4"/>
Oct 30 10:58:04 user nova-compute[74278]:         </nova:port>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:port uuid="0d26599a-8ac3-408a-b67c-d1d9041e3d72">
Oct 30 10:58:04 user nova-compute[74278]:           <nova:ip type="fixed" address="10.1.1.52" ipVersion="4"/>
Oct 30 10:58:04 user nova-compute[74278]:         </nova:port>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:port uuid="e90182c7-f21f-4f96-88de-46c9272e577e">
Oct 30 10:58:04 user nova-compute[74278]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 30 10:58:04 user nova-compute[74278]:         </nova:port>
Oct 30 10:58:04 user nova-compute[74278]:         <nova:port uuid="e898cb36-b040-4316-b0e2-9d6af4724592">
Oct 30 10:58:04 user nova-compute[74278]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 30 10:58:04 user nova-compute[74278]:         </nova:port>
Oct 30 10:58:04 user nova-compute[74278]:       </nova:ports>
Oct 30 10:58:04 user nova-compute[74278]:     </nova:instance>
Oct 30 10:58:04 user nova-compute[74278]:   </metadata>
Oct 30 10:58:04 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:58:04 user nova-compute[74278]:     <system>
Oct 30 10:58:04 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:58:04 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:58:04 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:58:04 user nova-compute[74278]:       <entry name="serial">f5fec1d4-833e-44db-8226-795fd62b18d8</entry>
Oct 30 10:58:04 user nova-compute[74278]:       <entry name="uuid">f5fec1d4-833e-44db-8226-795fd62b18d8</entry>
Oct 30 10:58:04 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:58:04 user nova-compute[74278]:     </system>
Oct 30 10:58:04 user nova-compute[74278]:   </sysinfo>
Oct 30 10:58:04 user nova-compute[74278]:   <os>
Oct 30 10:58:04 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:58:04 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:58:04 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:58:04 user nova-compute[74278]:   </os>
Oct 30 10:58:04 user nova-compute[74278]:   <features>
Oct 30 10:58:04 user nova-compute[74278]:     <acpi/>
Oct 30 10:58:04 user nova-compute[74278]:     <apic/>
Oct 30 10:58:04 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:58:04 user nova-compute[74278]:   </features>
Oct 30 10:58:04 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:58:04 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:58:04 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:58:04 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:58:04 user nova-compute[74278]:   </clock>
Oct 30 10:58:04 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:58:04 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:58:04 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:58:04 user nova-compute[74278]:   </cpu>
Oct 30 10:58:04 user nova-compute[74278]:   <devices>
Oct 30 10:58:04 user nova-compute[74278]:     <disk type="file" device="cdrom">
Oct 30 10:58:04 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none"/>
Oct 30 10:58:04 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/f5fec1d4-833e-44db-8226-795fd62b18d8/disk.config"/>
Oct 30 10:58:04 user nova-compute[74278]:       <target dev="hda" bus="ide"/>
Oct 30 10:58:04 user nova-compute[74278]:     </disk>
Oct 30 10:58:04 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 10:58:04 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:58:04 user nova-compute[74278]:       <source dev="/dev/sdc"/>
Oct 30 10:58:04 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:58:04 user nova-compute[74278]:       <serial>b566a64a-aadb-4270-8fe4-b3599498df80</serial>
Oct 30 10:58:04 user nova-compute[74278]:     </disk>
Oct 30 10:58:04 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 10:58:04 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:58:04 user nova-compute[74278]:       <source dev="/dev/sde"/>
Oct 30 10:58:04 user nova-compute[74278]:       <target dev="vdb" bus="virtio"/>
Oct 30 10:58:04 user nova-compute[74278]:       <serial>f0b5fa84-3517-4e41-999f-b8cfb51e56d9</serial>
Oct 30 10:58:04 user nova-compute[74278]:     </disk>
Oct 30 10:58:04 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 10:58:04 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:58:04 user nova-compute[74278]:       <source dev="/dev/sdg"/>
Oct 30 10:58:04 user nova-compute[74278]:       <target dev="vdc" bus="virtio"/>
Oct 30 10:58:04 user nova-compute[74278]:       <serial>51111d83-06f8-4619-83bc-ada1b2363b39</serial>
Oct 30 10:58:04 user nova-compute[74278]:     </disk>
Oct 30 10:58:04 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:58:04 user nova-compute[74278]:       <mac address="fa:16:3e:0e:fc:3d"/>
Oct 30 10:58:04 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:58:04 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:58:04 user nova-compute[74278]:       <target dev="tapd300f067-44"/>
Oct 30 10:58:04 user nova-compute[74278]:     </interface>
Oct 30 10:58:04 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:58:04 user nova-compute[74278]:       <mac address="fa:16:3e:13:b3:c6"/>
Oct 30 10:58:04 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:58:04 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:58:04 user nova-compute[74278]:       <target dev="tap645e6816-b4"/>
Oct 30 10:58:04 user nova-compute[74278]:     </interface>
Oct 30 10:58:04 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:58:04 user nova-compute[74278]:       <mac address="fa:16:3e:c4:df:d1"/>
Oct 30 10:58:04 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:58:04 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:58:04 user nova-compute[74278]:       <target dev="tap487a7419-c1"/>
Oct 30 10:58:04 user nova-compute[74278]:     </interface>
Oct 30 10:58:04 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:58:04 user nova-compute[74278]:       <mac address="fa:16:3e:fe:0a:29"/>
Oct 30 10:58:04 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:58:04 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:58:04 user nova-compute[74278]:       <target dev="tapb92be7d7-88"/>
Oct 30 10:58:04 user nova-compute[74278]:     </interface>
Oct 30 10:58:04 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:58:04 user nova-compute[74278]:       <mac address="fa:16:3e:85:da:01"/>
Oct 30 10:58:04 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:58:04 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:58:04 user nova-compute[74278]:       <target dev="tap0d26599a-8a"/>
Oct 30 10:58:04 user nova-compute[74278]:     </interface>
Oct 30 10:58:04 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:58:04 user nova-compute[74278]:       <mac address="fa:16:3e:e3:5c:19"/>
Oct 30 10:58:04 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:58:04 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:58:04 user nova-compute[74278]:       <target dev="tape90182c7-f2"/>
Oct 30 10:58:04 user nova-compute[74278]:     </interface>
Oct 30 10:58:04 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:58:04 user nova-compute[74278]:       <mac address="fa:16:3e:f7:70:58"/>
Oct 30 10:58:04 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:58:04 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:58:04 user nova-compute[74278]:       <target dev="tape898cb36-b0"/>
Oct 30 10:58:04 user nova-compute[74278]:     </interface>
Oct 30 10:58:04 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:58:04 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/f5fec1d4-833e-44db-8226-795fd62b18d8/console.log" append="off"/>
Oct 30 10:58:04 user nova-compute[74278]:     </serial>
Oct 30 10:58:04 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:58:04 user nova-compute[74278]:     <video>
Oct 30 10:58:04 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:58:04 user nova-compute[74278]:     </video>
Oct 30 10:58:04 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:58:04 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:58:04 user nova-compute[74278]:     </rng>
Oct 30 10:58:04 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:58:04 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:58:04 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:58:04 user nova-compute[74278]:     </memballoon>
Oct 30 10:58:04 user nova-compute[74278]:   </devices>
Oct 30 10:58:04 user nova-compute[74278]: </domain>
Oct 30 10:58:04 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:fc:3d,bridge_name='br-int',has_traffic_filtering=True,id=d300f067-441e-4d3b-a83a-f7eddbcb58fc,network=Network(0f0be984-c96c-43a4-b9b1-20765fd1279a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd300f067-44') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:fc:3d,bridge_name='br-int',has_traffic_filtering=True,id=d300f067-441e-4d3b-a83a-f7eddbcb58fc,network=Network(0f0be984-c96c-43a4-b9b1-20765fd1279a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd300f067-44') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d642206-30a4-5249-b3fb-ca303d0dc10d', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd300f067-44, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd300f067-44, col_values=(('qos', UUID('e4da0623-eaf8-4d20-83ad-fdd8acc9dc07')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd300f067-44, col_values=(('external_ids', {'iface-id': 'd300f067-441e-4d3b-a83a-f7eddbcb58fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:fc:3d', 'vm-uuid': 'f5fec1d4-833e-44db-8226-795fd62b18d8'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: INFO os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:fc:3d,bridge_name='br-int',has_traffic_filtering=True,id=d300f067-441e-4d3b-a83a-f7eddbcb58fc,network=Network(0f0be984-c96c-43a4-b9b1-20765fd1279a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd300f067-44')
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=645e6816-b45e-455b-b558-039baf08d79a,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap645e6816-b4') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=645e6816-b45e-455b-b558-039baf08d79a,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap645e6816-b4') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbe9070d-5850-5f0f-be8f-38c392d9450c', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap645e6816-b4, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap645e6816-b4, col_values=(('qos', UUID('3d26a52c-8c5b-4615-8b3d-78b7b98c864b')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap645e6816-b4, col_values=(('external_ids', {'iface-id': '645e6816-b45e-455b-b558-039baf08d79a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:b3:c6', 'vm-uuid': 'f5fec1d4-833e-44db-8226-795fd62b18d8'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: INFO os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=645e6816-b45e-455b-b558-039baf08d79a,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap645e6816-b4')
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:df:d1,bridge_name='br-int',has_traffic_filtering=True,id=487a7419-c1b7-4d9f-81a0-b52e76795926,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap487a7419-c1') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:df:d1,bridge_name='br-int',has_traffic_filtering=True,id=487a7419-c1b7-4d9f-81a0-b52e76795926,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap487a7419-c1') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e29060e2-57c0-5593-8ae8-b7c75fb71f40', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap487a7419-c1, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap487a7419-c1, col_values=(('qos', UUID('607bd2be-15db-45ab-baef-f3aa82072197')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap487a7419-c1, col_values=(('external_ids', {'iface-id': '487a7419-c1b7-4d9f-81a0-b52e76795926', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:df:d1', 'vm-uuid': 'f5fec1d4-833e-44db-8226-795fd62b18d8'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: INFO os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:df:d1,bridge_name='br-int',has_traffic_filtering=True,id=487a7419-c1b7-4d9f-81a0-b52e76795926,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap487a7419-c1')
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:0a:29,bridge_name='br-int',has_traffic_filtering=True,id=b92be7d7-88bb-45e4-b5b8-94d127ad295f,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92be7d7-88') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:0a:29,bridge_name='br-int',has_traffic_filtering=True,id=b92be7d7-88bb-45e4-b5b8-94d127ad295f,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92be7d7-88') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4793144c-ae74-5e47-8e4f-4e7c49853f0e', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb92be7d7-88, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb92be7d7-88, col_values=(('qos', UUID('151054d2-e997-482b-bd12-064b3a909101')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb92be7d7-88, col_values=(('external_ids', {'iface-id': 'b92be7d7-88bb-45e4-b5b8-94d127ad295f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:0a:29', 'vm-uuid': 'f5fec1d4-833e-44db-8226-795fd62b18d8'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: INFO os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:0a:29,bridge_name='br-int',has_traffic_filtering=True,id=b92be7d7-88bb-45e4-b5b8-94d127ad295f,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92be7d7-88')
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "address": "fa:16:3e:85:da:01", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d26599a-8a", "ovs_interfaceid": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "address": "fa:16:3e:85:da:01", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d26599a-8a", "ovs_interfaceid": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:da:01,bridge_name='br-int',has_traffic_filtering=True,id=0d26599a-8ac3-408a-b67c-d1d9041e3d72,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d26599a-8a') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:da:01,bridge_name='br-int',has_traffic_filtering=True,id=0d26599a-8ac3-408a-b67c-d1d9041e3d72,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d26599a-8a') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60a58905-48cd-5a20-9711-8007bddd7f45', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d26599a-8a, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d26599a-8a, col_values=(('qos', UUID('2648c39a-3cbf-4766-a301-3a4f314e124d')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d26599a-8a, col_values=(('external_ids', {'iface-id': '0d26599a-8ac3-408a-b67c-d1d9041e3d72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:da:01', 'vm-uuid': 'f5fec1d4-833e-44db-8226-795fd62b18d8'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: INFO os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:da:01,bridge_name='br-int',has_traffic_filtering=True,id=0d26599a-8ac3-408a-b67c-d1d9041e3d72,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d26599a-8a')
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e90182c7-f21f-4f96-88de-46c9272e577e,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90182c7-f2') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e90182c7-f21f-4f96-88de-46c9272e577e,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90182c7-f2') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4049354e-e379-5aad-be36-caa0ab0d5630', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape90182c7-f2, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape90182c7-f2, col_values=(('qos', UUID('5ab3e169-a446-4ffe-a312-7d1ef4a3686e')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape90182c7-f2, col_values=(('external_ids', {'iface-id': 'e90182c7-f21f-4f96-88de-46c9272e577e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:5c:19', 'vm-uuid': 'f5fec1d4-833e-44db-8226-795fd62b18d8'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: INFO os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e90182c7-f21f-4f96-88de-46c9272e577e,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90182c7-f2')
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e898cb36-b040-4316-b0e2-9d6af4724592", "address": "fa:16:3e:f7:70:58", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape898cb36-b0", "ovs_interfaceid": "e898cb36-b040-4316-b0e2-9d6af4724592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "e898cb36-b040-4316-b0e2-9d6af4724592", "address": "fa:16:3e:f7:70:58", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape898cb36-b0", "ovs_interfaceid": "e898cb36-b040-4316-b0e2-9d6af4724592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:70:58,bridge_name='br-int',has_traffic_filtering=True,id=e898cb36-b040-4316-b0e2-9d6af4724592,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape898cb36-b0') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:70:58,bridge_name='br-int',has_traffic_filtering=True,id=e898cb36-b040-4316-b0e2-9d6af4724592,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape898cb36-b0') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22a703ae-af75-5e42-836d-f580b11a4fd8', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape898cb36-b0, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape898cb36-b0, col_values=(('qos', UUID('d7ddd044-574e-4bce-9711-c4d840d2c561')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape898cb36-b0, col_values=(('external_ids', {'iface-id': 'e898cb36-b040-4316-b0e2-9d6af4724592', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:70:58', 'vm-uuid': 'f5fec1d4-833e-44db-8226-795fd62b18d8'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:05 user nova-compute[74278]: INFO os_vif [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:70:58,bridge_name='br-int',has_traffic_filtering=True,id=e898cb36-b040-4316-b0e2-9d6af4724592,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape898cb36-b0')
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] No BDM found with device name hda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] No VIF found with MAC fa:16:3e:0e:fc:3d, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:58:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] No VIF found with MAC fa:16:3e:85:da:01, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:58:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Using config drive
Oct 30 10:58:06 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Creating config drive at /opt/stack/data/nova/instances/f5fec1d4-833e-44db-8226-795fd62b18d8/disk.config
Oct 30 10:58:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f5fec1d4-833e-44db-8226-795fd62b18d8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpye800fsz {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f5fec1d4-833e-44db-8226-795fd62b18d8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpye800fsz" returned: 0 in 0.057s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-d7d93688-a610-4a86-9fa8-cbe3e94707b3 req-20624296-c2ca-41a0-9898-0fe5a5bee22c service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d7d93688-a610-4a86-9fa8-cbe3e94707b3 req-20624296-c2ca-41a0-9898-0fe5a5bee22c service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d7d93688-a610-4a86-9fa8-cbe3e94707b3 req-20624296-c2ca-41a0-9898-0fe5a5bee22c service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d7d93688-a610-4a86-9fa8-cbe3e94707b3 req-20624296-c2ca-41a0-9898-0fe5a5bee22c service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-d7d93688-a610-4a86-9fa8-cbe3e94707b3 req-20624296-c2ca-41a0-9898-0fe5a5bee22c service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:07 user nova-compute[74278]: WARNING nova.compute.manager [req-d7d93688-a610-4a86-9fa8-cbe3e94707b3 req-20624296-c2ca-41a0-9898-0fe5a5bee22c service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-d300f067-441e-4d3b-a83a-f7eddbcb58fc for instance with vm_state building and task_state spawning.
Oct 30 10:58:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-b03082e5-ee91-4147-bd95-29f0a344f882 req-cd55f7d2-dd4b-43e6-bdd7-046e50dac803 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b03082e5-ee91-4147-bd95-29f0a344f882 req-cd55f7d2-dd4b-43e6-bdd7-046e50dac803 service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b03082e5-ee91-4147-bd95-29f0a344f882 req-cd55f7d2-dd4b-43e6-bdd7-046e50dac803 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b03082e5-ee91-4147-bd95-29f0a344f882 req-cd55f7d2-dd4b-43e6-bdd7-046e50dac803 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-b03082e5-ee91-4147-bd95-29f0a344f882 req-cd55f7d2-dd4b-43e6-bdd7-046e50dac803 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:09 user nova-compute[74278]: WARNING nova.compute.manager [req-b03082e5-ee91-4147-bd95-29f0a344f882 req-cd55f7d2-dd4b-43e6-bdd7-046e50dac803 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-b92be7d7-88bb-45e4-b5b8-94d127ad295f for instance with vm_state building and task_state spawning.
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:09 user nova-compute[74278]: WARNING nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-d300f067-441e-4d3b-a83a-f7eddbcb58fc for instance with vm_state building and task_state spawning.
Oct 30 10:58:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-645e6816-b45e-455b-b558-039baf08d79a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-645e6816-b45e-455b-b558-039baf08d79a {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:09 user nova-compute[74278]: WARNING nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-645e6816-b45e-455b-b558-039baf08d79a for instance with vm_state building and task_state spawning.
Oct 30 10:58:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-645e6816-b45e-455b-b558-039baf08d79a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-645e6816-b45e-455b-b558-039baf08d79a {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:09 user nova-compute[74278]: WARNING nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-645e6816-b45e-455b-b558-039baf08d79a for instance with vm_state building and task_state spawning.
Oct 30 10:58:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-487a7419-c1b7-4d9f-81a0-b52e76795926 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-487a7419-c1b7-4d9f-81a0-b52e76795926 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:09 user nova-compute[74278]: WARNING nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-487a7419-c1b7-4d9f-81a0-b52e76795926 for instance with vm_state building and task_state spawning.
Oct 30 10:58:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-487a7419-c1b7-4d9f-81a0-b52e76795926 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-487a7419-c1b7-4d9f-81a0-b52e76795926 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:09 user nova-compute[74278]: WARNING nova.compute.manager [req-b267e217-20ec-4518-bb5e-27524130bb43 req-fd9f13ae-d7be-4db5-bfc1-0b9cab9eb49f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-487a7419-c1b7-4d9f-81a0-b52e76795926 for instance with vm_state building and task_state spawning.
Oct 30 10:58:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-aa6fcc4e-fa42-46b3-b7c6-05d0f5c8ea4e req-d361c052-0086-44c3-a772-1bfff7bd7166 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-aa6fcc4e-fa42-46b3-b7c6-05d0f5c8ea4e req-d361c052-0086-44c3-a772-1bfff7bd7166 service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-aa6fcc4e-fa42-46b3-b7c6-05d0f5c8ea4e req-d361c052-0086-44c3-a772-1bfff7bd7166 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-aa6fcc4e-fa42-46b3-b7c6-05d0f5c8ea4e req-d361c052-0086-44c3-a772-1bfff7bd7166 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-aa6fcc4e-fa42-46b3-b7c6-05d0f5c8ea4e req-d361c052-0086-44c3-a772-1bfff7bd7166 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:10 user nova-compute[74278]: WARNING nova.compute.manager [req-aa6fcc4e-fa42-46b3-b7c6-05d0f5c8ea4e req-d361c052-0086-44c3-a772-1bfff7bd7166 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-e90182c7-f21f-4f96-88de-46c9272e577e for instance with vm_state building and task_state spawning.
Oct 30 10:58:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:11 user nova-compute[74278]: WARNING nova.compute.manager [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-b92be7d7-88bb-45e4-b5b8-94d127ad295f for instance with vm_state building and task_state spawning.
Oct 30 10:58:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:11 user nova-compute[74278]: WARNING nova.compute.manager [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-0d26599a-8ac3-408a-b67c-d1d9041e3d72 for instance with vm_state building and task_state spawning.
Oct 30 10:58:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:11 user nova-compute[74278]: WARNING nova.compute.manager [req-4880ae9b-d229-40e0-8810-4206dbe076b3 req-aa7c60e6-ae5a-4829-ae0c-e259156c59b3 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-0d26599a-8ac3-408a-b67c-d1d9041e3d72 for instance with vm_state building and task_state spawning.
Oct 30 10:58:11 user nova-compute[74278]: INFO nova.compute.manager [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] instance snapshotting
Oct 30 10:58:11 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Beginning live snapshot process
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json -f qcow2 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json -f qcow2 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0vaw8vpn/5749f7f2e22c48c493171d4c9d85f229.delta 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:12 user nova-compute[74278]: WARNING nova.compute.manager [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-e90182c7-f21f-4f96-88de-46c9272e577e for instance with vm_state building and task_state spawning.
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:12 user nova-compute[74278]: WARNING nova.compute.manager [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-e898cb36-b040-4316-b0e2-9d6af4724592 for instance with vm_state building and task_state spawning.
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:12 user nova-compute[74278]: WARNING nova.compute.manager [req-61c8396a-0576-404c-afaf-1db31cb76b39 req-a74db0a8-b5c5-464a-a5f5-19ca1901bb67 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-e898cb36-b040-4316-b0e2-9d6af4724592 for instance with vm_state building and task_state spawning.
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0vaw8vpn/5749f7f2e22c48c493171d4c9d85f229.delta 1073741824" returned: 0 in 0.096s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:12 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:58:12 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Instance spawned successfully.
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:58:12 user nova-compute[74278]: INFO nova.compute.manager [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Took 12.19 seconds to spawn the instance on the hypervisor.
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:58:12 user nova-compute[74278]: INFO nova.compute.manager [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Took 84.44 seconds to build instance.
Oct 30 10:58:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-aa545696-69a4-4f6e-b03b-8fd830d6a5ce tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 84.566s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:58:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] COPY block job progress, current cursor: 24707072 final cursor: 75563008 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:58:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:58:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 10:58:14 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 10:58:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0vaw8vpn/5749f7f2e22c48c493171d4c9d85f229.delta /opt/stack/data/nova/instances/snapshots/tmp0vaw8vpn/5749f7f2e22c48c493171d4c9d85f229 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0vaw8vpn/5749f7f2e22c48c493171d4c9d85f229.delta /opt/stack/data/nova/instances/snapshots/tmp0vaw8vpn/5749f7f2e22c48c493171d4c9d85f229" returned: 0 in 0.495s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:14 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Snapshot extracted, beginning image upload
Oct 30 10:58:15 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:58:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquired lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:58:15 user nova-compute[74278]: DEBUG nova.network.neutron [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:58:15 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'info_cache' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:15 user nova-compute[74278]: DEBUG nova.objects.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:58:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:15 user nova-compute[74278]: DEBUG nova.network.neutron [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Updating instance_info_cache with network_info: [{"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:58:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Releasing lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:58:15 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance destroyed successfully.
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'resources' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.objects.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1903672377',display_name='tempest-AttachVolumeTestJSON-server-1903672377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1903672377',id=14,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw2A/RWC5+R4btriIoM9znu/g01+rQRK1t+3KnEGqXbGVndP3w3zXUjxA1EkRr8FgR+n/Ic2QTQuO6qPRQc5lNQ8uEvxmMbEmYIWKtUXYn+0cTj5aRqBB0fgw9nPXA5Dg==',key_name='tempest-keypair-1025364301',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='928164ecd5c44dddb93fbecfeaa44071',ramdisk_id='',reservation_id='r-o9r3qvit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2116287848',owner_user_name='tempest-AttachVolumeTestJSON-2116287848-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:56:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='525f98e0bed241fdad3962fda627b143',uuid=00dd2fe2-a888-44a1-9dfd-ad72acd03cfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converting VIF {"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_vif [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2c68f43-b8, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c39727b4-8a78-4131-aade-7f829edf9e70) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:16 user nova-compute[74278]: INFO os_vif [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8')
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geJNihYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:58:16 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a259569b-e507-413c-9866-dd62ba8f7ae1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:58:16 user nova-compute[74278]: No targets found.
Oct 30 10:58:16 user nova-compute[74278]: iSNS:
Oct 30 10:58:16 user nova-compute[74278]: No targets found.
Oct 30 10:58:16 user nova-compute[74278]: STATIC:
Oct 30 10:58:16 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c
Oct 30 10:58:16 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:58:16 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:58:16 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80
Oct 30 10:58:16 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:58:16 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:58:16 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39
Oct 30 10:58:16 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:58:16 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:58:16 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1
Oct 30 10:58:16 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:58:16 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:58:16 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9
Oct 30 10:58:16 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:58:16 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:58:16 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:58:16 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:58:16 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:58:16 user nova-compute[74278]: FIRMWARE:
Oct 30 10:58:16 user nova-compute[74278]: No targets found.
Oct 30 10:58:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:58:16 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:58:16 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8755b794-0650-4a85-a38e-cdc6ade014bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01be5b3-fc15-4ab3-9ac8-1b669b23fe3f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c4a7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26af59c-7148-4645-8d02-72b848b41a2e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b9617e-e5bc-40cc-9583-9f0a7802f11b]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f80f84f-55b7-46f8-8e60-bfb752507482]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac08dad-4603-46bb-a21a-9b37f3a342ec]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a30d978-1f77-4896-8696-d0d9db52d3f5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c43d7-3478-4ed5-9ca8-23fadbef32e8]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260]
Oct 30 10:58:16 user nova-compute[74278]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260] successful.
Oct 30 10:58:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ef50d3-1a9d-4f85-a023-c125871d1f1c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] <== disconnect_volume: return (412ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Start _get_guest_xml network_info=[{"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geJNihYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '00dd2fe2-a888-44a1-9dfd-ad72acd03cfa', 'attached_at': '', 'detached_at': '', 'volume_id': 'c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1', 'serial': 'c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1'}, 'attachment_id': '32ea9bf5-6f8a-4b6f-a7f7-839937f1ead8', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'numa_topology' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.objects.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:58:16 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:58:16 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.objects.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geJNihYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:58:16 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:58:16 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:58:16 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2132e713-6727-4268-82e3-35e184f7c707]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:58:16 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f22aeff-2050-4f8b-9832-1386f27aaeaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1] added
Oct 30 10:58:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da30e87-8a75-41e8-991f-9b931bd33b53]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a81780f-7ddb-446d-b445-7a28d50b5aa7]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geJNihYb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v geJNihYb" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac7c65f-c1cb-4a50-881e-65e65eef9630]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'geJNihYb'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dc54b1-9ccc-46b2-9e0f-29cab04b7f5f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7f24d2-7c92-46fa-bb2b-1131a5d28245]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[313eeadc-3b26-48af-a61a-255f33709045]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260]
Oct 30 10:58:16 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260] successful.
Oct 30 10:58:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3872caf5-68ab-4cf3-93ec-9cb141dd1405]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ccb861-c2e6-4c69-8fb3-dc751d76f5b1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[505e8157-7f99-41c3-af99-227fd39e2fa0]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:58:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geJNihYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:58:17 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Snapshot image upload complete
Oct 30 10:58:17 user nova-compute[74278]: INFO nova.compute.manager [None req-60209ca1-8e0c-42e0-84cb-566d676980c5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Took 6.60 seconds to snapshot the instance on the hypervisor.
Oct 30 10:58:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:58:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26364393730343739', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:58:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364393730343739', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1903672377',display_name='tempest-AttachVolumeTestJSON-server-1903672377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1903672377',id=14,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw2A/RWC5+R4btriIoM9znu/g01+rQRK1t+3KnEGqXbGVndP3w3zXUjxA1EkRr8FgR+n/Ic2QTQuO6qPRQc5lNQ8uEvxmMbEmYIWKtUXYn+0cTj5aRqBB0fgw9nPXA5Dg==',key_name='tempest-keypair-1025364301',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='928164ecd5c44dddb93fbecfeaa44071',ramdisk_id='',reservation_id='r-o9r3qvit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2116287848',owner_user_name='tempest-AttachVolumeTestJSON-2116287848-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:56:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='525f98e0bed241fdad3962fda627b143',uuid=00dd2fe2-a888-44a1-9dfd-ad72acd03cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converting VIF {"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'pci_devices' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.objects.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:58:18 user nova-compute[74278]:   <uuid>00dd2fe2-a888-44a1-9dfd-ad72acd03cfa</uuid>
Oct 30 10:58:18 user nova-compute[74278]:   <name>instance-0000000e</name>
Oct 30 10:58:18 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:58:18 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:58:18 user nova-compute[74278]:   <metadata>
Oct 30 10:58:18 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:58:18 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:58:18 user nova-compute[74278]:       <nova:name>tempest-AttachVolumeTestJSON-server-1903672377</nova:name>
Oct 30 10:58:18 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:58:16</nova:creationTime>
Oct 30 10:58:18 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:58:18 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:58:18 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:58:18 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:58:18 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:58:18 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:58:18 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:58:18 user nova-compute[74278]:       <nova:owner>
Oct 30 10:58:18 user nova-compute[74278]:         <nova:user uuid="525f98e0bed241fdad3962fda627b143">tempest-AttachVolumeTestJSON-2116287848-project-member</nova:user>
Oct 30 10:58:18 user nova-compute[74278]:         <nova:project uuid="928164ecd5c44dddb93fbecfeaa44071">tempest-AttachVolumeTestJSON-2116287848</nova:project>
Oct 30 10:58:18 user nova-compute[74278]:       </nova:owner>
Oct 30 10:58:18 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:58:18 user nova-compute[74278]:       <nova:ports>
Oct 30 10:58:18 user nova-compute[74278]:         <nova:port uuid="c2c68f43-b884-4bf0-8948-447c35ce1402">
Oct 30 10:58:18 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 10:58:18 user nova-compute[74278]:         </nova:port>
Oct 30 10:58:18 user nova-compute[74278]:       </nova:ports>
Oct 30 10:58:18 user nova-compute[74278]:     </nova:instance>
Oct 30 10:58:18 user nova-compute[74278]:   </metadata>
Oct 30 10:58:18 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:58:18 user nova-compute[74278]:     <system>
Oct 30 10:58:18 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:58:18 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:58:18 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:58:18 user nova-compute[74278]:       <entry name="serial">00dd2fe2-a888-44a1-9dfd-ad72acd03cfa</entry>
Oct 30 10:58:18 user nova-compute[74278]:       <entry name="uuid">00dd2fe2-a888-44a1-9dfd-ad72acd03cfa</entry>
Oct 30 10:58:18 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:58:18 user nova-compute[74278]:     </system>
Oct 30 10:58:18 user nova-compute[74278]:   </sysinfo>
Oct 30 10:58:18 user nova-compute[74278]:   <os>
Oct 30 10:58:18 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:58:18 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:58:18 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:58:18 user nova-compute[74278]:   </os>
Oct 30 10:58:18 user nova-compute[74278]:   <features>
Oct 30 10:58:18 user nova-compute[74278]:     <acpi/>
Oct 30 10:58:18 user nova-compute[74278]:     <apic/>
Oct 30 10:58:18 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:58:18 user nova-compute[74278]:   </features>
Oct 30 10:58:18 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:58:18 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:58:18 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:58:18 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:58:18 user nova-compute[74278]:   </clock>
Oct 30 10:58:18 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:58:18 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:58:18 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:58:18 user nova-compute[74278]:   </cpu>
Oct 30 10:58:18 user nova-compute[74278]:   <devices>
Oct 30 10:58:18 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:58:18 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:58:18 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk"/>
Oct 30 10:58:18 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:58:18 user nova-compute[74278]:     </disk>
Oct 30 10:58:18 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 10:58:18 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:58:18 user nova-compute[74278]:       <source dev="/dev/sdb"/>
Oct 30 10:58:18 user nova-compute[74278]:       <target dev="vdb" bus="virtio"/>
Oct 30 10:58:18 user nova-compute[74278]:       <serial>c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1</serial>
Oct 30 10:58:18 user nova-compute[74278]:     </disk>
Oct 30 10:58:18 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:58:18 user nova-compute[74278]:       <mac address="fa:16:3e:86:86:a1"/>
Oct 30 10:58:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:58:18 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:58:18 user nova-compute[74278]:       <target dev="tapc2c68f43-b8"/>
Oct 30 10:58:18 user nova-compute[74278]:     </interface>
Oct 30 10:58:18 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:58:18 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/console.log" append="off"/>
Oct 30 10:58:18 user nova-compute[74278]:     </serial>
Oct 30 10:58:18 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:58:18 user nova-compute[74278]:     <video>
Oct 30 10:58:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:58:18 user nova-compute[74278]:     </video>
Oct 30 10:58:18 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:58:18 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:58:18 user nova-compute[74278]:     </rng>
Oct 30 10:58:18 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:58:18 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:58:18 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:58:18 user nova-compute[74278]:     </memballoon>
Oct 30 10:58:18 user nova-compute[74278]:   </devices>
Oct 30 10:58:18 user nova-compute[74278]: </domain>
Oct 30 10:58:18 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.objects.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Cannot resize image /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'migration_context' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.objects.base [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1903672377',display_name='tempest-AttachVolumeTestJSON-server-1903672377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1903672377',id=14,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw2A/RWC5+R4btriIoM9znu/g01+rQRK1t+3KnEGqXbGVndP3w3zXUjxA1EkRr8FgR+n/Ic2QTQuO6qPRQc5lNQ8uEvxmMbEmYIWKtUXYn+0cTj5aRqBB0fgw9nPXA5Dg==',key_name='tempest-keypair-1025364301',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='928164ecd5c44dddb93fbecfeaa44071',ramdisk_id='',reservation_id='r-o9r3qvit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2116287848',owner_user_name='tempest-AttachVolumeTestJSON-2116287848-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:56:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='525f98e0bed241fdad3962fda627b143',uuid=00dd2fe2-a888-44a1-9dfd-ad72acd03cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converting VIF {"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG os_vif [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:58:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8469df57-5f47-51a9-bc7d-b385d03a17bf', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2c68f43-b8, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2c68f43-b8, col_values=(('qos', UUID('6c39c58e-b2ab-49ca-9125-ca1824511704')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2c68f43-b8, col_values=(('external_ids', {'iface-id': 'c2c68f43-b884-4bf0-8948-447c35ce1402', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:86:a1', 'vm-uuid': '00dd2fe2-a888-44a1-9dfd-ad72acd03cfa'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:19 user nova-compute[74278]: INFO os_vif [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8')
Oct 30 10:58:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:20 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:58:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:20 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:58:20 user nova-compute[74278]: INFO nova.compute.claims [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Claim successful on node user
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-8047c76e-4630-4e06-bc6f-42f70fa90f11 req-b6063bf5-1c0c-43e7-bc1f-06b55e597d2d service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8047c76e-4630-4e06-bc6f-42f70fa90f11 req-b6063bf5-1c0c-43e7-bc1f-06b55e597d2d service nova] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8047c76e-4630-4e06-bc6f-42f70fa90f11 req-b6063bf5-1c0c-43e7-bc1f-06b55e597d2d service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8047c76e-4630-4e06-bc6f-42f70fa90f11 req-b6063bf5-1c0c-43e7-bc1f-06b55e597d2d service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-8047c76e-4630-4e06-bc6f-42f70fa90f11 req-b6063bf5-1c0c-43e7-bc1f-06b55e597d2d service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] No waiting events found dispatching network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:21 user nova-compute[74278]: WARNING nova.compute.manager [req-8047c76e-4630-4e06-bc6f-42f70fa90f11 req-b6063bf5-1c0c-43e7-bc1f-06b55e597d2d service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received unexpected event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 for instance with vm_state stopped and task_state powering-on.
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.749s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:58:21 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.policy [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c4560d0bf034d30a8d8d6fac7d347f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba4eff185f543aa8c590fe74f59c7b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-fd7b431d-11fe-4f72-8642-4431a7364e66 req-1232c3f5-d675-4a13-9b3b-0b105625d879 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Received event network-changed-ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-fd7b431d-11fe-4f72-8642-4431a7364e66 req-1232c3f5-d675-4a13-9b3b-0b105625d879 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Refreshing instance network info cache due to event network-changed-ef16226b-834e-4b0a-943c-52883de41281. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fd7b431d-11fe-4f72-8642-4431a7364e66 req-1232c3f5-d675-4a13-9b3b-0b105625d879 service nova] Acquiring lock "refresh_cache-5ed94499-397a-4dc4-94da-13eb67312572" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fd7b431d-11fe-4f72-8642-4431a7364e66 req-1232c3f5-d675-4a13-9b3b-0b105625d879 service nova] Acquired lock "refresh_cache-5ed94499-397a-4dc4-94da-13eb67312572" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.network.neutron [req-fd7b431d-11fe-4f72-8642-4431a7364e66 req-1232c3f5-d675-4a13-9b3b-0b105625d879 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Refreshing network info cache for port ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:58:21 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Creating image(s)
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "/opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "/opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "03f79da8864d96d35b4d6d69edcc82ff6ee11dde" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "03f79da8864d96d35b4d6d69edcc82ff6ee11dde" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde.part --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:22 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:58:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "5ed94499-397a-4dc4-94da-13eb67312572" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:22 user nova-compute[74278]: DEBUG nova.objects.instance [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lazy-loading 'flavor' on Instance uuid 5ed94499-397a-4dc4-94da-13eb67312572 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "5ed94499-397a-4dc4-94da-13eb67312572" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde.part --force-share --output=json" returned: 0 in 0.255s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.virt.images [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] 19d820c7-6c21-4ce1-9c3c-275e4d340999 was qcow2, converting to raw {{(pid=74278) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde.part /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde.converted {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-27e40972-f382-4350-b5bf-9bbe312ded79 req-fa2ce5b8-69f6-466f-b5ce-d66fc0edbc39 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-27e40972-f382-4350-b5bf-9bbe312ded79 req-fa2ce5b8-69f6-466f-b5ce-d66fc0edbc39 service nova] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-27e40972-f382-4350-b5bf-9bbe312ded79 req-fa2ce5b8-69f6-466f-b5ce-d66fc0edbc39 service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-27e40972-f382-4350-b5bf-9bbe312ded79 req-fa2ce5b8-69f6-466f-b5ce-d66fc0edbc39 service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-27e40972-f382-4350-b5bf-9bbe312ded79 req-fa2ce5b8-69f6-466f-b5ce-d66fc0edbc39 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] No waiting events found dispatching network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:23 user nova-compute[74278]: WARNING nova.compute.manager [req-27e40972-f382-4350-b5bf-9bbe312ded79 req-fa2ce5b8-69f6-466f-b5ce-d66fc0edbc39 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received unexpected event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 for instance with vm_state stopped and task_state powering-on.
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "5ed94499-397a-4dc4-94da-13eb67312572" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:23 user nova-compute[74278]: INFO nova.compute.manager [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Attaching volume 6a5f0606-50af-4c7c-82dc-876d226675bd to /dev/vdb
Oct 30 10:58:23 user nova-compute[74278]: DEBUG os_brick.utils [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3381f055-e1ca-439a-b18d-91ec566d570d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a17f5d-3aef-459d-ba21-bdc7bff001cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde.part /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde.converted" returned: 0 in 0.314s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde.converted --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.network.neutron [req-fd7b431d-11fe-4f72-8642-4431a7364e66 req-1232c3f5-d675-4a13-9b3b-0b105625d879 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Updated VIF entry in instance network info cache for port ef16226b-834e-4b0a-943c-52883de41281. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.network.neutron [req-fd7b431d-11fe-4f72-8642-4431a7364e66 req-1232c3f5-d675-4a13-9b3b-0b105625d879 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Updating instance_info_cache with network_info: [{"id": "ef16226b-834e-4b0a-943c-52883de41281", "address": "fa:16:3e:c1:06:31", "network": {"id": "810116c1-412d-4c6d-b69a-a2f8855639bc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1852542095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396392292c2446ceaec276ff74a110b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef16226b-83", "ovs_interfaceid": "ef16226b-834e-4b0a-943c-52883de41281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d7c6a2-112a-4d86-86fb-7d7dd32b5cb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b58a0b-6299-4843-bca3-3004df3e4e0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fd7b431d-11fe-4f72-8642-4431a7364e66 req-1232c3f5-d675-4a13-9b3b-0b105625d879 service nova] Releasing lock "refresh_cache-5ed94499-397a-4dc4-94da-13eb67312572" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Skipping network cache update for instance because it is Building. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:58:23 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f286c95-ec4a-465a-ad03-c87872f339d8]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG os_brick.utils [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] <== get_connector_properties: return (295ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Updating existing volume attachment record: 6a1aa245-9410-4406-b00a-92048a67cbfb {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "03f79da8864d96d35b4d6d69edcc82ff6ee11dde" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.800s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance rebooted successfully.
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-a1d0b78a-ec99-4cdd-96f0-eb8a44821d67 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.objects.instance [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lazy-loading 'info_cache' on Instance uuid da67673a-dbe6-419f-8547-5ca730f14003 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde --force-share --output=json" returned: 0 in 0.232s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "03f79da8864d96d35b4d6d69edcc82ff6ee11dde" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "03f79da8864d96d35b4d6d69edcc82ff6ee11dde" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:23 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Successfully created port: a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde --force-share --output=json" returned: 0 in 0.258s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde,backing_fmt=raw /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde,backing_fmt=raw /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk 1073741824" returned: 0 in 0.069s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "03f79da8864d96d35b4d6d69edcc82ff6ee11dde" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde --force-share --output=json" returned: 0 in 0.231s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Ensure instance console log exists: /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Updating instance_info_cache with network_info: [{"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.011s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.004s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Successfully updated port: a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "refresh_cache-a6ad2df0-d37c-43f8-bb93-1fb3894b4593" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquired lock "refresh_cache-a6ad2df0-d37c-43f8-bb93-1fb3894b4593" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG nova.compute.manager [req-9d21d20f-1b2d-4338-b1a2-d888225c0226 req-cf38d614-4312-4dee-bdd6-c9c5d41eab08 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Received event network-changed-a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG nova.compute.manager [req-9d21d20f-1b2d-4338-b1a2-d888225c0226 req-cf38d614-4312-4dee-bdd6-c9c5d41eab08 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Refreshing instance network info cache due to event network-changed-a7c51798-cdc7-4e93-992e-38005422a757. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9d21d20f-1b2d-4338-b1a2-d888225c0226 req-cf38d614-4312-4dee-bdd6-c9c5d41eab08 service nova] Acquiring lock "refresh_cache-a6ad2df0-d37c-43f8-bb93-1fb3894b4593" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Updating instance_info_cache with network_info: [{"id": "a7c51798-cdc7-4e93-992e-38005422a757", "address": "fa:16:3e:55:71:cd", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c51798-cd", "ovs_interfaceid": "a7c51798-cdc7-4e93-992e-38005422a757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Releasing lock "refresh_cache-a6ad2df0-d37c-43f8-bb93-1fb3894b4593" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Instance network_info: |[{"id": "a7c51798-cdc7-4e93-992e-38005422a757", "address": "fa:16:3e:55:71:cd", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c51798-cd", "ovs_interfaceid": "a7c51798-cdc7-4e93-992e-38005422a757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9d21d20f-1b2d-4338-b1a2-d888225c0226 req-cf38d614-4312-4dee-bdd6-c9c5d41eab08 service nova] Acquired lock "refresh_cache-a6ad2df0-d37c-43f8-bb93-1fb3894b4593" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.network.neutron [req-9d21d20f-1b2d-4338-b1a2-d888225c0226 req-cf38d614-4312-4dee-bdd6-c9c5d41eab08 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Refreshing network info cache for port a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Start _get_guest_xml network_info=[{"id": "a7c51798-cdc7-4e93-992e-38005422a757", "address": "fa:16:3e:55:71:cd", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c51798-cd", "ovs_interfaceid": "a7c51798-cdc7-4e93-992e-38005422a757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='27a4e632c1ba39599ffcf921188f23fa',container_format='bare',created_at=2023-10-30T10:58:11Z,direct_url=<?>,disk_format='qcow2',id=19d820c7-6c21-4ce1-9c3c-275e4d340999,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1609398402',owner='0ba4eff185f543aa8c590fe74f59c7b8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T10:58:18Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '19d820c7-6c21-4ce1-9c3c-275e4d340999'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:58:26 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:58:26 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='27a4e632c1ba39599ffcf921188f23fa',container_format='bare',created_at=2023-10-30T10:58:11Z,direct_url=<?>,disk_format='qcow2',id=19d820c7-6c21-4ce1-9c3c-275e4d340999,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1609398402',owner='0ba4eff185f543aa8c590fe74f59c7b8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T10:58:18Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1922749226',display_name='tempest-TestStampPattern-server-1922749226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1922749226',id=21,image_ref='19d820c7-6c21-4ce1-9c3c-275e4d340999',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErJIPGly6W6lNejwEf8DtSNy5OrG6xfE/nDhPvCgU8od+RfEYPhZ5Qc+GqAO9q9/7KpAJWL/Kivlo794MTyR38r0U10CkXp6EajAwqkYjjkVym0Mb+QFcYi/6SagifxZw==',key_name='tempest-TestStampPattern-1979010860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba4eff185f543aa8c590fe74f59c7b8',ramdisk_id='',reservation_id='r-c2kjz2kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9cba7c39-a2d1-44c0-a866-01c22a3f3634',image_min_disk='1',image_min_ram='0',image_owner_id='0ba4eff185f543aa8c590fe74f59c7b8',image_owner_project_name='tempest-TestStampPattern-1462524641',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1462524641-project-member',image_user_id='0c4560d0bf034d30a8d8d6fac7d347f8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1462524641',owner_user_name='tempest-TestStampPattern-1462524641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:58:22Z,user_data=None,user_id='0c4560d0bf034d30a8d8d6fac7d347f8',uuid=a6ad2df0-d37c-43f8-bb93-1fb3894b4593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7c51798-cdc7-4e93-992e-38005422a757", "address": "fa:16:3e:55:71:cd", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c51798-cd", "ovs_interfaceid": "a7c51798-cdc7-4e93-992e-38005422a757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Converting VIF {"id": "a7c51798-cdc7-4e93-992e-38005422a757", "address": "fa:16:3e:55:71:cd", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c51798-cd", "ovs_interfaceid": "a7c51798-cdc7-4e93-992e-38005422a757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=a7c51798-cdc7-4e93-992e-38005422a757,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c51798-cd') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.objects.instance [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lazy-loading 'pci_devices' on Instance uuid a6ad2df0-d37c-43f8-bb93-1fb3894b4593 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:58:26 user nova-compute[74278]:   <uuid>a6ad2df0-d37c-43f8-bb93-1fb3894b4593</uuid>
Oct 30 10:58:26 user nova-compute[74278]:   <name>instance-00000015</name>
Oct 30 10:58:26 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:58:26 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:58:26 user nova-compute[74278]:   <metadata>
Oct 30 10:58:26 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:58:26 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:58:26 user nova-compute[74278]:       <nova:name>tempest-TestStampPattern-server-1922749226</nova:name>
Oct 30 10:58:26 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:58:26</nova:creationTime>
Oct 30 10:58:26 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:58:26 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:58:26 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:58:26 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:58:26 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:58:26 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:58:26 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:58:26 user nova-compute[74278]:       <nova:owner>
Oct 30 10:58:26 user nova-compute[74278]:         <nova:user uuid="0c4560d0bf034d30a8d8d6fac7d347f8">tempest-TestStampPattern-1462524641-project-member</nova:user>
Oct 30 10:58:26 user nova-compute[74278]:         <nova:project uuid="0ba4eff185f543aa8c590fe74f59c7b8">tempest-TestStampPattern-1462524641</nova:project>
Oct 30 10:58:26 user nova-compute[74278]:       </nova:owner>
Oct 30 10:58:26 user nova-compute[74278]:       <nova:root type="image" uuid="19d820c7-6c21-4ce1-9c3c-275e4d340999"/>
Oct 30 10:58:26 user nova-compute[74278]:       <nova:ports>
Oct 30 10:58:26 user nova-compute[74278]:         <nova:port uuid="a7c51798-cdc7-4e93-992e-38005422a757">
Oct 30 10:58:26 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 10:58:26 user nova-compute[74278]:         </nova:port>
Oct 30 10:58:26 user nova-compute[74278]:       </nova:ports>
Oct 30 10:58:26 user nova-compute[74278]:     </nova:instance>
Oct 30 10:58:26 user nova-compute[74278]:   </metadata>
Oct 30 10:58:26 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:58:26 user nova-compute[74278]:     <system>
Oct 30 10:58:26 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:58:26 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:58:26 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:58:26 user nova-compute[74278]:       <entry name="serial">a6ad2df0-d37c-43f8-bb93-1fb3894b4593</entry>
Oct 30 10:58:26 user nova-compute[74278]:       <entry name="uuid">a6ad2df0-d37c-43f8-bb93-1fb3894b4593</entry>
Oct 30 10:58:26 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:58:26 user nova-compute[74278]:     </system>
Oct 30 10:58:26 user nova-compute[74278]:   </sysinfo>
Oct 30 10:58:26 user nova-compute[74278]:   <os>
Oct 30 10:58:26 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:58:26 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:58:26 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:58:26 user nova-compute[74278]:   </os>
Oct 30 10:58:26 user nova-compute[74278]:   <features>
Oct 30 10:58:26 user nova-compute[74278]:     <acpi/>
Oct 30 10:58:26 user nova-compute[74278]:     <apic/>
Oct 30 10:58:26 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:58:26 user nova-compute[74278]:   </features>
Oct 30 10:58:26 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:58:26 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:58:26 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:58:26 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:58:26 user nova-compute[74278]:   </clock>
Oct 30 10:58:26 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:58:26 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:58:26 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:58:26 user nova-compute[74278]:   </cpu>
Oct 30 10:58:26 user nova-compute[74278]:   <devices>
Oct 30 10:58:26 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:58:26 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:58:26 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk"/>
Oct 30 10:58:26 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:58:26 user nova-compute[74278]:     </disk>
Oct 30 10:58:26 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:58:26 user nova-compute[74278]:       <mac address="fa:16:3e:55:71:cd"/>
Oct 30 10:58:26 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:58:26 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:58:26 user nova-compute[74278]:       <target dev="tapa7c51798-cd"/>
Oct 30 10:58:26 user nova-compute[74278]:     </interface>
Oct 30 10:58:26 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:58:26 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/console.log" append="off"/>
Oct 30 10:58:26 user nova-compute[74278]:     </serial>
Oct 30 10:58:26 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:58:26 user nova-compute[74278]:     <video>
Oct 30 10:58:26 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:58:26 user nova-compute[74278]:     </video>
Oct 30 10:58:26 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:58:26 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:58:26 user nova-compute[74278]:     </rng>
Oct 30 10:58:26 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:58:26 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:58:26 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:58:26 user nova-compute[74278]:     </memballoon>
Oct 30 10:58:26 user nova-compute[74278]:   </devices>
Oct 30 10:58:26 user nova-compute[74278]: </domain>
Oct 30 10:58:26 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1922749226',display_name='tempest-TestStampPattern-server-1922749226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1922749226',id=21,image_ref='19d820c7-6c21-4ce1-9c3c-275e4d340999',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErJIPGly6W6lNejwEf8DtSNy5OrG6xfE/nDhPvCgU8od+RfEYPhZ5Qc+GqAO9q9/7KpAJWL/Kivlo794MTyR38r0U10CkXp6EajAwqkYjjkVym0Mb+QFcYi/6SagifxZw==',key_name='tempest-TestStampPattern-1979010860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ba4eff185f543aa8c590fe74f59c7b8',ramdisk_id='',reservation_id='r-c2kjz2kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9cba7c39-a2d1-44c0-a866-01c22a3f3634',image_min_disk='1',image_min_ram='0',image_owner_id='0ba4eff185f543aa8c590fe74f59c7b8',image_owner_project_name='tempest-TestStampPattern-1462524641',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1462524641-project-member',image_user_id='0c4560d0bf034d30a8d8d6fac7d347f8',network_allocated='True',owner_project_name='tempest-TestStampPattern-1462524641',owner_user_name='tempest-TestStampPattern-1462524641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:58:22Z,user_data=None,user_id='0c4560d0bf034d30a8d8d6fac7d347f8',uuid=a6ad2df0-d37c-43f8-bb93-1fb3894b4593,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7c51798-cdc7-4e93-992e-38005422a757", "address": "fa:16:3e:55:71:cd", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c51798-cd", "ovs_interfaceid": "a7c51798-cdc7-4e93-992e-38005422a757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Converting VIF {"id": "a7c51798-cdc7-4e93-992e-38005422a757", "address": "fa:16:3e:55:71:cd", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c51798-cd", "ovs_interfaceid": "a7c51798-cdc7-4e93-992e-38005422a757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=a7c51798-cdc7-4e93-992e-38005422a757,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c51798-cd') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG os_vif [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=a7c51798-cdc7-4e93-992e-38005422a757,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c51798-cd') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ecd30e2-00ff-56f8-8f12-e24993544cf4', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7c51798-cd, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7c51798-cd, col_values=(('qos', UUID('ef3e7677-4f27-444c-8b83-bb7d5e31b2c5')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7c51798-cd, col_values=(('external_ids', {'iface-id': 'a7c51798-cdc7-4e93-992e-38005422a757', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:71:cd', 'vm-uuid': 'a6ad2df0-d37c-43f8-bb93-1fb3894b4593'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:26 user nova-compute[74278]: INFO os_vif [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=a7c51798-cdc7-4e93-992e-38005422a757,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c51798-cd')
Oct 30 10:58:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] No VIF found with MAC fa:16:3e:55:71:cd, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.network.neutron [req-9d21d20f-1b2d-4338-b1a2-d888225c0226 req-cf38d614-4312-4dee-bdd6-c9c5d41eab08 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Updated VIF entry in instance network info cache for port a7c51798-cdc7-4e93-992e-38005422a757. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG nova.network.neutron [req-9d21d20f-1b2d-4338-b1a2-d888225c0226 req-cf38d614-4312-4dee-bdd6-c9c5d41eab08 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Updating instance_info_cache with network_info: [{"id": "a7c51798-cdc7-4e93-992e-38005422a757", "address": "fa:16:3e:55:71:cd", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c51798-cd", "ovs_interfaceid": "a7c51798-cdc7-4e93-992e-38005422a757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9d21d20f-1b2d-4338-b1a2-d888225c0226 req-cf38d614-4312-4dee-bdd6-c9c5d41eab08 service nova] Releasing lock "refresh_cache-a6ad2df0-d37c-43f8-bb93-1fb3894b4593" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:58:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-9b1f7a68-2495-4a94-bf55-11ae5219562a req-3f5045b9-c548-4ef4-b33f-98751756a7fb service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Received event network-vif-plugged-a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9b1f7a68-2495-4a94-bf55-11ae5219562a req-3f5045b9-c548-4ef4-b33f-98751756a7fb service nova] Acquiring lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9b1f7a68-2495-4a94-bf55-11ae5219562a req-3f5045b9-c548-4ef4-b33f-98751756a7fb service nova] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9b1f7a68-2495-4a94-bf55-11ae5219562a req-3f5045b9-c548-4ef4-b33f-98751756a7fb service nova] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-9b1f7a68-2495-4a94-bf55-11ae5219562a req-3f5045b9-c548-4ef4-b33f-98751756a7fb service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] No waiting events found dispatching network-vif-plugged-a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:28 user nova-compute[74278]: WARNING nova.compute.manager [req-9b1f7a68-2495-4a94-bf55-11ae5219562a req-3f5045b9-c548-4ef4-b33f-98751756a7fb service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Received unexpected event network-vif-plugged-a7c51798-cdc7-4e93-992e-38005422a757 for instance with vm_state building and task_state spawning.
Oct 30 10:58:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:58:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:31 user nova-compute[74278]: DEBUG nova.compute.manager [req-6768055a-b2f2-4463-9dfa-cc9291372c26 req-b419b814-6eac-4179-a429-efb08111b567 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Received event network-vif-plugged-a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:58:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6768055a-b2f2-4463-9dfa-cc9291372c26 req-b419b814-6eac-4179-a429-efb08111b567 service nova] Acquiring lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6768055a-b2f2-4463-9dfa-cc9291372c26 req-b419b814-6eac-4179-a429-efb08111b567 service nova] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6768055a-b2f2-4463-9dfa-cc9291372c26 req-b419b814-6eac-4179-a429-efb08111b567 service nova] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:31 user nova-compute[74278]: DEBUG nova.compute.manager [req-6768055a-b2f2-4463-9dfa-cc9291372c26 req-b419b814-6eac-4179-a429-efb08111b567 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] No waiting events found dispatching network-vif-plugged-a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:58:31 user nova-compute[74278]: WARNING nova.compute.manager [req-6768055a-b2f2-4463-9dfa-cc9291372c26 req-b419b814-6eac-4179-a429-efb08111b567 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Received unexpected event network-vif-plugged-a7c51798-cdc7-4e93-992e-38005422a757 for instance with vm_state building and task_state spawning.
Oct 30 10:58:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:58:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:58:31 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:58:31 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:58:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7479MB free_disk=24.979656219482422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:58:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:31 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Instance spawned successfully.
Oct 30 10:58:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:58:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:58:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:58:32 user nova-compute[74278]: INFO nova.compute.manager [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Took 10.28 seconds to spawn the instance on the hypervisor.
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 55cf7cd9-4e0b-4caa-874e-4963079e3b10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 5ed94499-397a-4dc4-94da-13eb67312572 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance f5fec1d4-833e-44db-8226-795fd62b18d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance d6bdec9e-b5dc-483d-b89e-ece814c92e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a6ad2df0-d37c-43f8-bb93-1fb3894b4593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:58:32 user nova-compute[74278]: INFO nova.compute.manager [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Took 11.56 seconds to build instance.
Oct 30 10:58:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b32bea03-c88c-41af-a490-78a950a689e5 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.738s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:58:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.797s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:34 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:58:34 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:58:34 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:58:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlEDrgZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:58:48 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:58:48 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:58:48 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0fd444-9944-4cfc-bf6a-8e123bb7d476]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:58:48 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[020876e0-ee1f-4363-b822-40079636f54b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd] added
Oct 30 10:58:48 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb849777-0906-4e64-9be7-2a927834ed37]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cd4ab3-b960-497d-9c05-f9dd2d809636]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlEDrgZO {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlEDrgZO" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[569be84b-5f34-4225-b60e-ef2206313755]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dlEDrgZO'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[831a7f83-ce69-45f1-8308-88b6a6ae8d6b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efab163-21f4-4abc-bac6-b43ed251c318]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:48 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:48 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:48 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:48 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:58:48 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:48 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:48 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:48 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:48 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:48 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:58:48 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:48 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:58:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e827b7-a6d5-4800-bd3b-bb70d5d0bbdf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260]
Oct 30 10:58:49 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260] successful.
Oct 30 10:58:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c09feca-c888-4fbe-a7cc-60f40d20775c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf93dfef-6aea-4be3-b34d-30863e07cc4f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:49 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:49 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:49 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:49 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:58:49 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:49 user nova-compute[74278]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 10:58:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:58:49 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:58:49 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:58:49 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:58:49 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:58:49 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:58:49 user nova-compute[74278]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 10:58:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] HCTL ('39', '-', '-', 0) found on session 22 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95ab915-75b2-4797-be60-056976dfd7db]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Searching for a device in session 22 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlEDrgZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:58:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:58:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26337343033313436', 'path': '/dev/sdh'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:58:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337343033313436', 'path': '/dev/sdh'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:58:50 user nova-compute[74278]: DEBUG nova.objects.instance [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lazy-loading 'flavor' on Instance uuid 5ed94499-397a-4dc4-94da-13eb67312572 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:58:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 10:58:50 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 10:58:50 user nova-compute[74278]:   <source dev="/dev/sdh"/>
Oct 30 10:58:50 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 10:58:50 user nova-compute[74278]:   <serial>6a5f0606-50af-4c7c-82dc-876d226675bd</serial>
Oct 30 10:58:50 user nova-compute[74278]: </disk>
Oct 30 10:58:50 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 10:58:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:58:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:58:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] No VIF found with MAC fa:16:3e:c1:06:31, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:58:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-722fab9e-6e19-4aaf-b220-37eb225066dd tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "5ed94499-397a-4dc4-94da-13eb67312572" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.627s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "5ed94499-397a-4dc4-94da-13eb67312572" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:51 user nova-compute[74278]: DEBUG os_brick.utils [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:58:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1a184f-836d-4310-8a69-ff592050ea87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.045s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83eb6c1-e9c7-4a17-9f82-cb8b77ddb3ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cc311b-2ec1-45b0-ba5a-9a89664ab0a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f636d2-38a6-4797-8ee4-756bb778fd3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:58:52 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:58:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6149f26c-9574-49f4-b259-a4c67dc26e36]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:58:52 user nova-compute[74278]: DEBUG os_brick.utils [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:58:52 user nova-compute[74278]: INFO nova.compute.manager [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Swapping volume 6a5f0606-50af-4c7c-82dc-876d226675bd for adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0
Oct 30 10:58:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "64287717-7d3b-4087-aedf-faf87be774a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "64287717-7d3b-4087-aedf-faf87be774a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:58:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:57 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:58:57 user nova-compute[74278]: INFO nova.compute.claims [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Claim successful on node user
Oct 30 10:58:58 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:58:58 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:58:58 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG nova.policy [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6e338955c2f4d4fae81e9fbf93eff39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6de366be034e23a4d60302674b76c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:58:58 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Creating image(s)
Oct 30 10:58:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "/opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "/opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "/opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.246s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Successfully created port: 0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.304s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk 1073741824" returned: 0 in 0.066s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.375s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Acquiring lock "2b8efca4-cec4-4179-99af-92172f9b8a06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.227s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:58:59 user nova-compute[74278]: INFO nova.compute.claims [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Claim successful on node user
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Cannot resize image /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Ensure instance console log exists: /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:58:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Successfully updated port: 0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "refresh_cache-64287717-7d3b-4087-aedf-faf87be774a8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquired lock "refresh_cache-64287717-7d3b-4087-aedf-faf87be774a8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-e316c732-99d6-4291-8f6d-c5e3ff391676 req-8bdbed48-148c-4488-9cb6-e8660753d182 service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Received event network-changed-0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-e316c732-99d6-4291-8f6d-c5e3ff391676 req-8bdbed48-148c-4488-9cb6-e8660753d182 service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Refreshing instance network info cache due to event network-changed-0fd8caf3-4c43-425d-95b8-47207d7d73be. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e316c732-99d6-4291-8f6d-c5e3ff391676 req-8bdbed48-148c-4488-9cb6-e8660753d182 service nova] Acquiring lock "refresh_cache-64287717-7d3b-4087-aedf-faf87be774a8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Updating instance_info_cache with network_info: [{"id": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "address": "fa:16:3e:7d:e1:79", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd8caf3-4c", "ovs_interfaceid": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.820s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Releasing lock "refresh_cache-64287717-7d3b-4087-aedf-faf87be774a8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Instance network_info: |[{"id": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "address": "fa:16:3e:7d:e1:79", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd8caf3-4c", "ovs_interfaceid": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e316c732-99d6-4291-8f6d-c5e3ff391676 req-8bdbed48-148c-4488-9cb6-e8660753d182 service nova] Acquired lock "refresh_cache-64287717-7d3b-4087-aedf-faf87be774a8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-e316c732-99d6-4291-8f6d-c5e3ff391676 req-8bdbed48-148c-4488-9cb6-e8660753d182 service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Refreshing network info cache for port 0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Start _get_guest_xml network_info=[{"id": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "address": "fa:16:3e:7d:e1:79", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd8caf3-4c", "ovs_interfaceid": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:59:00 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:59:00 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:58:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-309301792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-309301792',id=22,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-ij0dgamr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:58:58Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=64287717-7d3b-4087-aedf-faf87be774a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "address": "fa:16:3e:7d:e1:79", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd8caf3-4c", "ovs_interfaceid": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "address": "fa:16:3e:7d:e1:79", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd8caf3-4c", "ovs_interfaceid": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e1:79,bridge_name='br-int',has_traffic_filtering=True,id=0fd8caf3-4c43-425d-95b8-47207d7d73be,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd8caf3-4c') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'pci_devices' on Instance uuid 64287717-7d3b-4087-aedf-faf87be774a8 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:59:00 user nova-compute[74278]:   <uuid>64287717-7d3b-4087-aedf-faf87be774a8</uuid>
Oct 30 10:59:00 user nova-compute[74278]:   <name>instance-00000016</name>
Oct 30 10:59:00 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:59:00 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:59:00 user nova-compute[74278]:   <metadata>
Oct 30 10:59:00 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:59:00 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:59:00 user nova-compute[74278]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-309301792</nova:name>
Oct 30 10:59:00 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:59:00</nova:creationTime>
Oct 30 10:59:00 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:59:00 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:59:00 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:59:00 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:59:00 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:59:00 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:59:00 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:59:00 user nova-compute[74278]:       <nova:owner>
Oct 30 10:59:00 user nova-compute[74278]:         <nova:user uuid="e6e338955c2f4d4fae81e9fbf93eff39">tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member</nova:user>
Oct 30 10:59:00 user nova-compute[74278]:         <nova:project uuid="0f6de366be034e23a4d60302674b76c9">tempest-ServerBootFromVolumeStableRescueTest-1058902108</nova:project>
Oct 30 10:59:00 user nova-compute[74278]:       </nova:owner>
Oct 30 10:59:00 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:59:00 user nova-compute[74278]:       <nova:ports>
Oct 30 10:59:00 user nova-compute[74278]:         <nova:port uuid="0fd8caf3-4c43-425d-95b8-47207d7d73be">
Oct 30 10:59:00 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 10:59:00 user nova-compute[74278]:         </nova:port>
Oct 30 10:59:00 user nova-compute[74278]:       </nova:ports>
Oct 30 10:59:00 user nova-compute[74278]:     </nova:instance>
Oct 30 10:59:00 user nova-compute[74278]:   </metadata>
Oct 30 10:59:00 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:59:00 user nova-compute[74278]:     <system>
Oct 30 10:59:00 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:59:00 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:59:00 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:59:00 user nova-compute[74278]:       <entry name="serial">64287717-7d3b-4087-aedf-faf87be774a8</entry>
Oct 30 10:59:00 user nova-compute[74278]:       <entry name="uuid">64287717-7d3b-4087-aedf-faf87be774a8</entry>
Oct 30 10:59:00 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:59:00 user nova-compute[74278]:     </system>
Oct 30 10:59:00 user nova-compute[74278]:   </sysinfo>
Oct 30 10:59:00 user nova-compute[74278]:   <os>
Oct 30 10:59:00 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:59:00 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:59:00 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:59:00 user nova-compute[74278]:   </os>
Oct 30 10:59:00 user nova-compute[74278]:   <features>
Oct 30 10:59:00 user nova-compute[74278]:     <acpi/>
Oct 30 10:59:00 user nova-compute[74278]:     <apic/>
Oct 30 10:59:00 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:59:00 user nova-compute[74278]:   </features>
Oct 30 10:59:00 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:59:00 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:59:00 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:59:00 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:59:00 user nova-compute[74278]:   </clock>
Oct 30 10:59:00 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:59:00 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:59:00 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:59:00 user nova-compute[74278]:   </cpu>
Oct 30 10:59:00 user nova-compute[74278]:   <devices>
Oct 30 10:59:00 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:59:00 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:59:00 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk"/>
Oct 30 10:59:00 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:59:00 user nova-compute[74278]:     </disk>
Oct 30 10:59:00 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:59:00 user nova-compute[74278]:       <mac address="fa:16:3e:7d:e1:79"/>
Oct 30 10:59:00 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:59:00 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:59:00 user nova-compute[74278]:       <target dev="tap0fd8caf3-4c"/>
Oct 30 10:59:00 user nova-compute[74278]:     </interface>
Oct 30 10:59:00 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:59:00 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/console.log" append="off"/>
Oct 30 10:59:00 user nova-compute[74278]:     </serial>
Oct 30 10:59:00 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:59:00 user nova-compute[74278]:     <video>
Oct 30 10:59:00 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:59:00 user nova-compute[74278]:     </video>
Oct 30 10:59:00 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:59:00 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:59:00 user nova-compute[74278]:     </rng>
Oct 30 10:59:00 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:59:00 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:59:00 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:59:00 user nova-compute[74278]:     </memballoon>
Oct 30 10:59:00 user nova-compute[74278]:   </devices>
Oct 30 10:59:00 user nova-compute[74278]: </domain>
Oct 30 10:59:00 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:58:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-309301792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-309301792',id=22,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-ij0dgamr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:58:58Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=64287717-7d3b-4087-aedf-faf87be774a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "address": "fa:16:3e:7d:e1:79", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd8caf3-4c", "ovs_interfaceid": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "address": "fa:16:3e:7d:e1:79", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd8caf3-4c", "ovs_interfaceid": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e1:79,bridge_name='br-int',has_traffic_filtering=True,id=0fd8caf3-4c43-425d-95b8-47207d7d73be,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd8caf3-4c') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG os_vif [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e1:79,bridge_name='br-int',has_traffic_filtering=True,id=0fd8caf3-4c43-425d-95b8-47207d7d73be,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd8caf3-4c') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b8178c2-d3df-5a72-aaa9-d17335fa1183', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fd8caf3-4c, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fd8caf3-4c, col_values=(('qos', UUID('e232b124-60b8-417a-9175-1f8f7e243c39')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fd8caf3-4c, col_values=(('external_ids', {'iface-id': '0fd8caf3-4c43-425d-95b8-47207d7d73be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:e1:79', 'vm-uuid': '64287717-7d3b-4087-aedf-faf87be774a8'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:00 user nova-compute[74278]: INFO os_vif [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:e1:79,bridge_name='br-int',has_traffic_filtering=True,id=0fd8caf3-4c43-425d-95b8-47207d7d73be,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd8caf3-4c')
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No VIF found with MAC fa:16:3e:7d:e1:79, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.policy [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67d961bd648748fbb0c9371099737703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111e751160ba47198f17085be7a3214d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:59:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Creating image(s)
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "/opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "/opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG nova.network.neutron [req-e316c732-99d6-4291-8f6d-c5e3ff391676 req-8bdbed48-148c-4488-9cb6-e8660753d182 service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Updated VIF entry in instance network info cache for port 0fd8caf3-4c43-425d-95b8-47207d7d73be. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG nova.network.neutron [req-e316c732-99d6-4291-8f6d-c5e3ff391676 req-8bdbed48-148c-4488-9cb6-e8660753d182 service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Updating instance_info_cache with network_info: [{"id": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "address": "fa:16:3e:7d:e1:79", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd8caf3-4c", "ovs_interfaceid": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.185s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e316c732-99d6-4291-8f6d-c5e3ff391676 req-8bdbed48-148c-4488-9cb6-e8660753d182 service nova] Releasing lock "refresh_cache-64287717-7d3b-4087-aedf-faf87be774a8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk 1073741824" returned: 0 in 0.058s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.188s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Successfully created port: f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Cannot resize image /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Ensure instance console log exists: /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-f11a2bc3-6cae-4c03-a940-4e12b5d9c195 req-bcaa6cc2-dcb2-4a4a-a998-c21cba36e25c service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Received event network-vif-plugged-0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f11a2bc3-6cae-4c03-a940-4e12b5d9c195 req-bcaa6cc2-dcb2-4a4a-a998-c21cba36e25c service nova] Acquiring lock "64287717-7d3b-4087-aedf-faf87be774a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f11a2bc3-6cae-4c03-a940-4e12b5d9c195 req-bcaa6cc2-dcb2-4a4a-a998-c21cba36e25c service nova] Lock "64287717-7d3b-4087-aedf-faf87be774a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f11a2bc3-6cae-4c03-a940-4e12b5d9c195 req-bcaa6cc2-dcb2-4a4a-a998-c21cba36e25c service nova] Lock "64287717-7d3b-4087-aedf-faf87be774a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-f11a2bc3-6cae-4c03-a940-4e12b5d9c195 req-bcaa6cc2-dcb2-4a4a-a998-c21cba36e25c service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] No waiting events found dispatching network-vif-plugged-0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:02 user nova-compute[74278]: WARNING nova.compute.manager [req-f11a2bc3-6cae-4c03-a940-4e12b5d9c195 req-bcaa6cc2-dcb2-4a4a-a998-c21cba36e25c service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Received unexpected event network-vif-plugged-0fd8caf3-4c43-425d-95b8-47207d7d73be for instance with vm_state building and task_state spawning.
Oct 30 10:59:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Successfully updated port: f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Acquiring lock "refresh_cache-2b8efca4-cec4-4179-99af-92172f9b8a06" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Acquired lock "refresh_cache-2b8efca4-cec4-4179-99af-92172f9b8a06" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:59:02 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Updating instance_info_cache with network_info: [{"id": "f802cc84-3654-430b-8c5f-c862a7bababc", "address": "fa:16:3e:f4:6a:52", "network": {"id": "29f5a489-9312-45e1-9c8b-4d2ce9926744", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-775167779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111e751160ba47198f17085be7a3214d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf802cc84-36", "ovs_interfaceid": "f802cc84-3654-430b-8c5f-c862a7bababc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Releasing lock "refresh_cache-2b8efca4-cec4-4179-99af-92172f9b8a06" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Instance network_info: |[{"id": "f802cc84-3654-430b-8c5f-c862a7bababc", "address": "fa:16:3e:f4:6a:52", "network": {"id": "29f5a489-9312-45e1-9c8b-4d2ce9926744", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-775167779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111e751160ba47198f17085be7a3214d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf802cc84-36", "ovs_interfaceid": "f802cc84-3654-430b-8c5f-c862a7bababc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Start _get_guest_xml network_info=[{"id": "f802cc84-3654-430b-8c5f-c862a7bababc", "address": "fa:16:3e:f4:6a:52", "network": {"id": "29f5a489-9312-45e1-9c8b-4d2ce9926744", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-775167779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111e751160ba47198f17085be7a3214d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf802cc84-36", "ovs_interfaceid": "f802cc84-3654-430b-8c5f-c862a7bababc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:59:03 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:59:03 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-443132128',display_name='tempest-ServerStableDeviceRescueTest-server-443132128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-443132128',id=23,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnzdRxyG0AUok1KF+Au2eK/kJXGgVup8cs2DNmJ/l43OxgvfB0BCM4cNTWb4+G9dzh39Vb/F6+1zeA1AK7B+SJHhX6mcVnlhNBg8iSQFvFFvRo7u7peXBjTuxJGoPabUQ==',key_name='tempest-keypair-1062601204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='111e751160ba47198f17085be7a3214d',ramdisk_id='',reservation_id='r-r70rzbh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2138516490',owner_user_name='tempest-ServerStableDeviceRescueTest-2138516490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67d961bd648748fbb0c9371099737703',uuid=2b8efca4-cec4-4179-99af-92172f9b8a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f802cc84-3654-430b-8c5f-c862a7bababc", "address": "fa:16:3e:f4:6a:52", "network": {"id": "29f5a489-9312-45e1-9c8b-4d2ce9926744", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-775167779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111e751160ba47198f17085be7a3214d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf802cc84-36", "ovs_interfaceid": "f802cc84-3654-430b-8c5f-c862a7bababc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Converting VIF {"id": "f802cc84-3654-430b-8c5f-c862a7bababc", "address": "fa:16:3e:f4:6a:52", "network": {"id": "29f5a489-9312-45e1-9c8b-4d2ce9926744", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-775167779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111e751160ba47198f17085be7a3214d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf802cc84-36", "ovs_interfaceid": "f802cc84-3654-430b-8c5f-c862a7bababc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:6a:52,bridge_name='br-int',has_traffic_filtering=True,id=f802cc84-3654-430b-8c5f-c862a7bababc,network=Network(29f5a489-9312-45e1-9c8b-4d2ce9926744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf802cc84-36') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.objects.instance [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b8efca4-cec4-4179-99af-92172f9b8a06 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:59:03 user nova-compute[74278]:   <uuid>2b8efca4-cec4-4179-99af-92172f9b8a06</uuid>
Oct 30 10:59:03 user nova-compute[74278]:   <name>instance-00000017</name>
Oct 30 10:59:03 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:59:03 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:59:03 user nova-compute[74278]:   <metadata>
Oct 30 10:59:03 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:59:03 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:59:03 user nova-compute[74278]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-443132128</nova:name>
Oct 30 10:59:03 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:59:03</nova:creationTime>
Oct 30 10:59:03 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:59:03 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:59:03 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:59:03 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:59:03 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:59:03 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:59:03 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:59:03 user nova-compute[74278]:       <nova:owner>
Oct 30 10:59:03 user nova-compute[74278]:         <nova:user uuid="67d961bd648748fbb0c9371099737703">tempest-ServerStableDeviceRescueTest-2138516490-project-member</nova:user>
Oct 30 10:59:03 user nova-compute[74278]:         <nova:project uuid="111e751160ba47198f17085be7a3214d">tempest-ServerStableDeviceRescueTest-2138516490</nova:project>
Oct 30 10:59:03 user nova-compute[74278]:       </nova:owner>
Oct 30 10:59:03 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:59:03 user nova-compute[74278]:       <nova:ports>
Oct 30 10:59:03 user nova-compute[74278]:         <nova:port uuid="f802cc84-3654-430b-8c5f-c862a7bababc">
Oct 30 10:59:03 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 10:59:03 user nova-compute[74278]:         </nova:port>
Oct 30 10:59:03 user nova-compute[74278]:       </nova:ports>
Oct 30 10:59:03 user nova-compute[74278]:     </nova:instance>
Oct 30 10:59:03 user nova-compute[74278]:   </metadata>
Oct 30 10:59:03 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:59:03 user nova-compute[74278]:     <system>
Oct 30 10:59:03 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:59:03 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:59:03 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:59:03 user nova-compute[74278]:       <entry name="serial">2b8efca4-cec4-4179-99af-92172f9b8a06</entry>
Oct 30 10:59:03 user nova-compute[74278]:       <entry name="uuid">2b8efca4-cec4-4179-99af-92172f9b8a06</entry>
Oct 30 10:59:03 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:59:03 user nova-compute[74278]:     </system>
Oct 30 10:59:03 user nova-compute[74278]:   </sysinfo>
Oct 30 10:59:03 user nova-compute[74278]:   <os>
Oct 30 10:59:03 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:59:03 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:59:03 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:59:03 user nova-compute[74278]:   </os>
Oct 30 10:59:03 user nova-compute[74278]:   <features>
Oct 30 10:59:03 user nova-compute[74278]:     <acpi/>
Oct 30 10:59:03 user nova-compute[74278]:     <apic/>
Oct 30 10:59:03 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:59:03 user nova-compute[74278]:   </features>
Oct 30 10:59:03 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:59:03 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:59:03 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:59:03 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:59:03 user nova-compute[74278]:   </clock>
Oct 30 10:59:03 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:59:03 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:59:03 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:59:03 user nova-compute[74278]:   </cpu>
Oct 30 10:59:03 user nova-compute[74278]:   <devices>
Oct 30 10:59:03 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:59:03 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:59:03 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk"/>
Oct 30 10:59:03 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:59:03 user nova-compute[74278]:     </disk>
Oct 30 10:59:03 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:59:03 user nova-compute[74278]:       <mac address="fa:16:3e:f4:6a:52"/>
Oct 30 10:59:03 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:59:03 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:59:03 user nova-compute[74278]:       <target dev="tapf802cc84-36"/>
Oct 30 10:59:03 user nova-compute[74278]:     </interface>
Oct 30 10:59:03 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:59:03 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/console.log" append="off"/>
Oct 30 10:59:03 user nova-compute[74278]:     </serial>
Oct 30 10:59:03 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:59:03 user nova-compute[74278]:     <video>
Oct 30 10:59:03 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:59:03 user nova-compute[74278]:     </video>
Oct 30 10:59:03 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:59:03 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:59:03 user nova-compute[74278]:     </rng>
Oct 30 10:59:03 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:59:03 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:59:03 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:59:03 user nova-compute[74278]:     </memballoon>
Oct 30 10:59:03 user nova-compute[74278]:   </devices>
Oct 30 10:59:03 user nova-compute[74278]: </domain>
Oct 30 10:59:03 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-443132128',display_name='tempest-ServerStableDeviceRescueTest-server-443132128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-443132128',id=23,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnzdRxyG0AUok1KF+Au2eK/kJXGgVup8cs2DNmJ/l43OxgvfB0BCM4cNTWb4+G9dzh39Vb/F6+1zeA1AK7B+SJHhX6mcVnlhNBg8iSQFvFFvRo7u7peXBjTuxJGoPabUQ==',key_name='tempest-keypair-1062601204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='111e751160ba47198f17085be7a3214d',ramdisk_id='',reservation_id='r-r70rzbh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2138516490',owner_user_name='tempest-ServerStableDeviceRescueTest-2138516490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:59:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67d961bd648748fbb0c9371099737703',uuid=2b8efca4-cec4-4179-99af-92172f9b8a06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f802cc84-3654-430b-8c5f-c862a7bababc", "address": "fa:16:3e:f4:6a:52", "network": {"id": "29f5a489-9312-45e1-9c8b-4d2ce9926744", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-775167779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111e751160ba47198f17085be7a3214d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf802cc84-36", "ovs_interfaceid": "f802cc84-3654-430b-8c5f-c862a7bababc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Converting VIF {"id": "f802cc84-3654-430b-8c5f-c862a7bababc", "address": "fa:16:3e:f4:6a:52", "network": {"id": "29f5a489-9312-45e1-9c8b-4d2ce9926744", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-775167779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111e751160ba47198f17085be7a3214d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf802cc84-36", "ovs_interfaceid": "f802cc84-3654-430b-8c5f-c862a7bababc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:6a:52,bridge_name='br-int',has_traffic_filtering=True,id=f802cc84-3654-430b-8c5f-c862a7bababc,network=Network(29f5a489-9312-45e1-9c8b-4d2ce9926744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf802cc84-36') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG os_vif [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:6a:52,bridge_name='br-int',has_traffic_filtering=True,id=f802cc84-3654-430b-8c5f-c862a7bababc,network=Network(29f5a489-9312-45e1-9c8b-4d2ce9926744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf802cc84-36') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c0ffb8d1-33c3-59c5-be16-d6d6dbb85fb6', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf802cc84-36, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf802cc84-36, col_values=(('qos', UUID('c1d55d41-66cf-4ed4-9dd2-a52049174c17')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf802cc84-36, col_values=(('external_ids', {'iface-id': 'f802cc84-3654-430b-8c5f-c862a7bababc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:6a:52', 'vm-uuid': '2b8efca4-cec4-4179-99af-92172f9b8a06'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:03 user nova-compute[74278]: INFO os_vif [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:6a:52,bridge_name='br-int',has_traffic_filtering=True,id=f802cc84-3654-430b-8c5f-c862a7bababc,network=Network(29f5a489-9312-45e1-9c8b-4d2ce9926744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf802cc84-36')
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:59:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] No VIF found with MAC fa:16:3e:f4:6a:52, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Received event network-changed-f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Refreshing instance network info cache due to event network-changed-f802cc84-3654-430b-8c5f-c862a7bababc. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] Acquiring lock "refresh_cache-2b8efca4-cec4-4179-99af-92172f9b8a06" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] Acquired lock "refresh_cache-2b8efca4-cec4-4179-99af-92172f9b8a06" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.network.neutron [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Refreshing network info cache for port f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Instance spawned successfully.
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:04 user nova-compute[74278]: INFO nova.compute.manager [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Took 6.16 seconds to spawn the instance on the hypervisor.
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:59:04 user nova-compute[74278]: INFO nova.compute.manager [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Took 7.29 seconds to build instance.
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-78e004ba-88f5-4669-a054-9130c243882c req-7073ea48-2d78-4bfd-b696-3fa8c6f5b53c service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Received event network-vif-plugged-f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-78e004ba-88f5-4669-a054-9130c243882c req-7073ea48-2d78-4bfd-b696-3fa8c6f5b53c service nova] Acquiring lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-78e004ba-88f5-4669-a054-9130c243882c req-7073ea48-2d78-4bfd-b696-3fa8c6f5b53c service nova] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-78e004ba-88f5-4669-a054-9130c243882c req-7073ea48-2d78-4bfd-b696-3fa8c6f5b53c service nova] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-78e004ba-88f5-4669-a054-9130c243882c req-7073ea48-2d78-4bfd-b696-3fa8c6f5b53c service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] No waiting events found dispatching network-vif-plugged-f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:04 user nova-compute[74278]: WARNING nova.compute.manager [req-78e004ba-88f5-4669-a054-9130c243882c req-7073ea48-2d78-4bfd-b696-3fa8c6f5b53c service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Received unexpected event network-vif-plugged-f802cc84-3654-430b-8c5f-c862a7bababc for instance with vm_state building and task_state spawning.
Oct 30 10:59:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8f4b65e8-2b5b-4193-90ec-010d270f46bc tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "64287717-7d3b-4087-aedf-faf87be774a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.536s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:05 user nova-compute[74278]: DEBUG nova.network.neutron [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Updated VIF entry in instance network info cache for port f802cc84-3654-430b-8c5f-c862a7bababc. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:59:05 user nova-compute[74278]: DEBUG nova.network.neutron [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Updating instance_info_cache with network_info: [{"id": "f802cc84-3654-430b-8c5f-c862a7bababc", "address": "fa:16:3e:f4:6a:52", "network": {"id": "29f5a489-9312-45e1-9c8b-4d2ce9926744", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-775167779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111e751160ba47198f17085be7a3214d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf802cc84-36", "ovs_interfaceid": "f802cc84-3654-430b-8c5f-c862a7bababc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] Releasing lock "refresh_cache-2b8efca4-cec4-4179-99af-92172f9b8a06" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:59:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Received event network-vif-plugged-0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] Acquiring lock "64287717-7d3b-4087-aedf-faf87be774a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] Lock "64287717-7d3b-4087-aedf-faf87be774a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] Lock "64287717-7d3b-4087-aedf-faf87be774a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] No waiting events found dispatching network-vif-plugged-0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:05 user nova-compute[74278]: WARNING nova.compute.manager [req-51035a35-d2a4-4905-95ae-2e7899a8bbfa req-6460ec18-0898-4cc5-b32c-ef3ba0ab3aea service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Received unexpected event network-vif-plugged-0fd8caf3-4c43-425d-95b8-47207d7d73be for instance with vm_state building and task_state spawning.
Oct 30 10:59:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-1b979fef-1898-48d3-a00e-999c32fb511a req-5065ad18-e87b-4a6d-a23c-9ca7fc616b0f service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Received event network-vif-plugged-f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1b979fef-1898-48d3-a00e-999c32fb511a req-5065ad18-e87b-4a6d-a23c-9ca7fc616b0f service nova] Acquiring lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1b979fef-1898-48d3-a00e-999c32fb511a req-5065ad18-e87b-4a6d-a23c-9ca7fc616b0f service nova] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1b979fef-1898-48d3-a00e-999c32fb511a req-5065ad18-e87b-4a6d-a23c-9ca7fc616b0f service nova] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-1b979fef-1898-48d3-a00e-999c32fb511a req-5065ad18-e87b-4a6d-a23c-9ca7fc616b0f service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] No waiting events found dispatching network-vif-plugged-f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:06 user nova-compute[74278]: WARNING nova.compute.manager [req-1b979fef-1898-48d3-a00e-999c32fb511a req-5065ad18-e87b-4a6d-a23c-9ca7fc616b0f service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Received unexpected event network-vif-plugged-f802cc84-3654-430b-8c5f-c862a7bababc for instance with vm_state building and task_state spawning.
Oct 30 10:59:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:59:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:59:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Instance spawned successfully.
Oct 30 10:59:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:59:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:07 user nova-compute[74278]: INFO nova.compute.manager [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Took 6.39 seconds to spawn the instance on the hypervisor.
Oct 30 10:59:07 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:59:07 user nova-compute[74278]: INFO nova.compute.manager [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Took 7.72 seconds to build instance.
Oct 30 10:59:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d73814d8-ed70-4f5e-aa17-cf902a074f40 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.987s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-6328c01b-46fa-498d-84e5-bd383e48228f req-fdd77ddd-42ba-4730-9d6c-9af567fdd6c1 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received event network-changed-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-6328c01b-46fa-498d-84e5-bd383e48228f req-fdd77ddd-42ba-4730-9d6c-9af567fdd6c1 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Refreshing instance network info cache due to event network-changed-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:59:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6328c01b-46fa-498d-84e5-bd383e48228f req-fdd77ddd-42ba-4730-9d6c-9af567fdd6c1 service nova] Acquiring lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:59:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6328c01b-46fa-498d-84e5-bd383e48228f req-fdd77ddd-42ba-4730-9d6c-9af567fdd6c1 service nova] Acquired lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:59:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-6328c01b-46fa-498d-84e5-bd383e48228f req-fdd77ddd-42ba-4730-9d6c-9af567fdd6c1 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Refreshing network info cache for port 2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:59:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-6328c01b-46fa-498d-84e5-bd383e48228f req-fdd77ddd-42ba-4730-9d6c-9af567fdd6c1 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updated VIF entry in instance network info cache for port 2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:59:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-6328c01b-46fa-498d-84e5-bd383e48228f req-fdd77ddd-42ba-4730-9d6c-9af567fdd6c1 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updating instance_info_cache with network_info: [{"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6328c01b-46fa-498d-84e5-bd383e48228f req-fdd77ddd-42ba-4730-9d6c-9af567fdd6c1 service nova] Releasing lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnAfdErK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ed94499-397a-4dc4-94da-13eb67312572', 'attached_at': '', 'detached_at': '', 'volume_id': 'adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0', 'serial': 'adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlEDrgZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '5ed94499-397a-4dc4-94da-13eb67312572', 'attached_at': '', 'detached_at': '', 'volume_id': '6a5f0606-50af-4c7c-82dc-876d226675bd', 'serial'} {{(pid=74278) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnAfdErK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:59:16 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:59:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:59:16 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:59:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:59:16 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 10:59:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[475e6f8e-8d6c-488d-962e-967627b2d699]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 10:59:16 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b05e98-53bb-41fd-beb3-f9553a49c917]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0] added
Oct 30 10:59:16 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ebd6eb-3e10-4d62-aa4b-50e6cb976e49]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8335cc77-9a0f-4067-89bf-6fa96009b1e6]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnAfdErK {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MnAfdErK" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93afc87-ab4f-4178-ac66-b3c7ef7333a9]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MnAfdErK'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cbb705-e49c-4501-a3f8-dbfceaac25fc]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49e81e3-24a2-475c-a5af-ff8e2dcca889]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 10:59:17 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 10:59:17 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10411a9-5f71-45c7-80dc-aeb5a2fad41c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0, portal: 172.16.0.220,3260]
Oct 30 10:59:17 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0, portal: 172.16.0.220,3260] successful.
Oct 30 10:59:17 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3402867c-c440-4c55-9c2c-bbcaefa78a37]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c98b30-45ef-460a-bffd-b0393c208a2a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 10:59:17 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 10:59:17 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] HCTL ('40', '-', '-', 0) found on session 23 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae97688-b671-482b-b90c-6aae16ae95cd]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Searching for a device in session 23 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 10:59:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnAfdErK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 10:59:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:59:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '23435373731663637', 'path': '/dev/sdi'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:59:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435373731663637', 'path': '/dev/sdi'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 10:59:18 user nova-compute[74278]: DEBUG nova.objects.instance [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lazy-loading 'flavor' on Instance uuid 5ed94499-397a-4dc4-94da-13eb67312572 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:59:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:59:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 152043520 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:59:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 195035136 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:59:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 339738624 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:59:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 426770432 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:59:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 596639744 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:59:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 754974720 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:59:22 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:59:22 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:59:22 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:59:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 10:59:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 897581056 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 1034944512 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlEDrgZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:59:23 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:59:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dad0fd5-5b7a-4681-a1df-7290a3f26484]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:59:23 user nova-compute[74278]: No targets found.
Oct 30 10:59:23 user nova-compute[74278]: iSNS:
Oct 30 10:59:23 user nova-compute[74278]: No targets found.
Oct 30 10:59:23 user nova-compute[74278]: STATIC:
Oct 30 10:59:23 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c
Oct 30 10:59:23 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:23 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:23 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0
Oct 30 10:59:23 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:23 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:23 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80
Oct 30 10:59:23 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:23 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:23 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd
Oct 30 10:59:23 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:23 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:23 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39
Oct 30 10:59:23 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:23 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:23 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1
Oct 30 10:59:23 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:23 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:23 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9
Oct 30 10:59:23 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:23 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:23 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:59:23 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:23 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:23 user nova-compute[74278]: FIRMWARE:
Oct 30 10:59:23 user nova-compute[74278]: No targets found.
Oct 30 10:59:23 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:59:23 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:59:23 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:59:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.073s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[27393435-ac6b-4279-b31b-85416ab73434]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b133386-74b4-4750-bfb6-01e0372919fe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 10:59:24 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 10:59:24 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 10:59:24 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c4a7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd'): ({'sdh'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Removing single pathed devices sdh {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ec72c8-3a2c-4f23-b1a8-29fe6fc0a132]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a2578b-53b2-4c2c-9fd7-441c20ff8510]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Flushing IO for device /dev/sdh {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[464e3dc9-3f83-4628-a2c7-1d8f08b44f62]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1f1c3a-941c-429f-b149-ae227b9cd7ca]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] SCSI volumes sdh have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc3e571-3561-484c-b7b0-a69cda3bf001]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5e31c8-8615-4a7b-8bfe-979d6ea3c6c8]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260]
Oct 30 10:59:24 user nova-compute[74278]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260] successful.
Oct 30 10:59:24 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c257d6-5a16-43f2-845e-3a7ec66f7a08]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] <== disconnect_volume: return (458ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnAfdErK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '5ed94499-397a-4dc4-94da-13eb67312572', 'attached_at': '', 'detached_at': '', 'volume_id': 'adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0', 'serial'} {{(pid=74278) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] swap_volume: removing Cinder connection for volume 6a5f0606-50af-4c7c-82dc-876d226675bd {{(pid=74278) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:59:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:27 user nova-compute[74278]: INFO nova.compute.manager [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Terminating instance
Oct 30 10:59:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-22e5d6c3-a251-48a4-ba29-c6dc7178bfe7 req-b6bd8701-6769-4323-8c1a-e64fefc02fac service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-unplugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-22e5d6c3-a251-48a4-ba29-c6dc7178bfe7 req-b6bd8701-6769-4323-8c1a-e64fefc02fac service nova] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-22e5d6c3-a251-48a4-ba29-c6dc7178bfe7 req-b6bd8701-6769-4323-8c1a-e64fefc02fac service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-22e5d6c3-a251-48a4-ba29-c6dc7178bfe7 req-b6bd8701-6769-4323-8c1a-e64fefc02fac service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-22e5d6c3-a251-48a4-ba29-c6dc7178bfe7 req-b6bd8701-6769-4323-8c1a-e64fefc02fac service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] No waiting events found dispatching network-vif-unplugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-22e5d6c3-a251-48a4-ba29-c6dc7178bfe7 req-b6bd8701-6769-4323-8c1a-e64fefc02fac service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-unplugged-346d37bb-4749-43ab-b83e-c0472def78b2 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Instance destroyed successfully.
Oct 30 10:59:28 user nova-compute[74278]: DEBUG nova.objects.instance [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lazy-loading 'resources' on Instance uuid 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1697547587',display_name='tempest-ServerActionsTestOtherB-server-1697547587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1697547587',id=4,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxtrS9IHVw9VJCYjUF6eDWBKHwb7bFWD3A669NQggiEpEfM7XQnDLYLkziVDxGhK2ctlm9Mx1VSfhVfRehAdJNYHfhfvjHZCeNc+QL1vrbZckvK1AnRE3E7SPpnRLWh5Q==',key_name='tempest-keypair-979570287',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:57:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a59c309805c1416793e76777407ef388',ramdisk_id='',reservation_id='r-f0ytqg1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1708015848',owner_user_name='tempest-ServerActionsTestOtherB-1708015848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:57:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7002e346bd664217af927725af208c54',uuid=25c5ad55-f85b-4371-8bdf-95a6a0f4d73d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converting VIF {"id": "346d37bb-4749-43ab-b83e-c0472def78b2", "address": "fa:16:3e:8b:ee:5f", "network": {"id": "5c460d42-c163-4277-b5ce-3da4c08f8421", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-339457430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a59c309805c1416793e76777407ef388", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap346d37bb-47", "ovs_interfaceid": "346d37bb-4749-43ab-b83e-c0472def78b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_vif [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap346d37bb-47, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=889f4783-401c-4930-a0e3-d709e2a05291) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:28 user nova-compute[74278]: INFO os_vif [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ee:5f,bridge_name='br-int',has_traffic_filtering=True,id=346d37bb-4749-43ab-b83e-c0472def78b2,network=Network(5c460d42-c163-4277-b5ce-3da4c08f8421),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap346d37bb-47')
Oct 30 10:59:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxUyZTWd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:59:28 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67b6208-366b-4ca4-99ae-483f10f2a1b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:59:28 user nova-compute[74278]: No targets found.
Oct 30 10:59:28 user nova-compute[74278]: iSNS:
Oct 30 10:59:28 user nova-compute[74278]: No targets found.
Oct 30 10:59:28 user nova-compute[74278]: STATIC:
Oct 30 10:59:28 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c
Oct 30 10:59:28 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:28 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:28 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0
Oct 30 10:59:28 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:28 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:28 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80
Oct 30 10:59:28 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:28 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:28 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39
Oct 30 10:59:28 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:28 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:28 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1
Oct 30 10:59:28 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:28 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:28 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9
Oct 30 10:59:28 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:28 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:28 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:59:28 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:28 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:28 user nova-compute[74278]: FIRMWARE:
Oct 30 10:59:28 user nova-compute[74278]: No targets found.
Oct 30 10:59:28 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:59:28 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:59:28 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6c1afa-1684-4a18-a024-2ced6fc4c0e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d6411e-f233-4968-a348-c3b884a9bf03]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:28 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:59:28 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:59:28 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:59:28 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:28 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:28 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 10:59:28 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:28 user nova-compute[74278]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c (non-flash)
Oct 30 10:59:28 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:59:28 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:59:28 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:28 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:28 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 10:59:28 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c598790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c'): ({'sdd'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Removing single pathed devices sdd {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[415b94fa-4556-4966-af02-cea55b27c439]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9bfc15-17f6-45e7-862d-3b2f92d99090]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Flushing IO for device /dev/sdd {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee7177e-8122-46ff-958e-7a6b095b594f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[df29fccd-d575-4019-97bd-42ab745d7ecc]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceed3c0-0454-4a30-bd38-02a76ca5dfcb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fff8f7-7e69-4da4-853e-9162831d9e8a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260]
Oct 30 10:59:28 user nova-compute[74278]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c, portal: 172.16.0.220,3260] successful.
Oct 30 10:59:28 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0066f51-c274-4eea-9f0c-8acdcded086c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49a49bd-358c-4257-8dcb-c63330a19b2d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] <== disconnect_volume: return (459ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:59:28 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Deleting instance files /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d_del
Oct 30 10:59:28 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Deletion of /opt/stack/data/nova/instances/25c5ad55-f85b-4371-8bdf-95a6a0f4d73d_del complete
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:29 user nova-compute[74278]: INFO nova.compute.manager [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Took 1.68 seconds to destroy the instance on the hypervisor.
Oct 30 10:59:29 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG nova.compute.manager [req-a0b74bcf-55cc-4d93-85bf-12f2c35c7537 req-24f2f58d-2a8f-4a3c-b1f9-8327965c117c service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a0b74bcf-55cc-4d93-85bf-12f2c35c7537 req-24f2f58d-2a8f-4a3c-b1f9-8327965c117c service nova] Acquiring lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a0b74bcf-55cc-4d93-85bf-12f2c35c7537 req-24f2f58d-2a8f-4a3c-b1f9-8327965c117c service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a0b74bcf-55cc-4d93-85bf-12f2c35c7537 req-24f2f58d-2a8f-4a3c-b1f9-8327965c117c service nova] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:29 user nova-compute[74278]: DEBUG nova.compute.manager [req-a0b74bcf-55cc-4d93-85bf-12f2c35c7537 req-24f2f58d-2a8f-4a3c-b1f9-8327965c117c service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] No waiting events found dispatching network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:29 user nova-compute[74278]: WARNING nova.compute.manager [req-a0b74bcf-55cc-4d93-85bf-12f2c35c7537 req-24f2f58d-2a8f-4a3c-b1f9-8327965c117c service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received unexpected event network-vif-plugged-346d37bb-4749-43ab-b83e-c0472def78b2 for instance with vm_state active and task_state deleting.
Oct 30 10:59:29 user nova-compute[74278]: DEBUG nova.compute.manager [req-ec7881f8-f796-43aa-9140-bb3e0450394a req-b1f83f95-8a65-4997-a64d-1b1a0a52a8d5 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Received event network-vif-deleted-346d37bb-4749-43ab-b83e-c0472def78b2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:30 user nova-compute[74278]: INFO nova.compute.manager [req-ec7881f8-f796-43aa-9140-bb3e0450394a req-b1f83f95-8a65-4997-a64d-1b1a0a52a8d5 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Neutron deleted interface 346d37bb-4749-43ab-b83e-c0472def78b2; detaching it from the instance and deleting it from the info cache
Oct 30 10:59:30 user nova-compute[74278]: DEBUG nova.network.neutron [req-ec7881f8-f796-43aa-9140-bb3e0450394a req-b1f83f95-8a65-4997-a64d-1b1a0a52a8d5 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:30 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:30 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Took 1.01 seconds to deallocate network for instance.
Oct 30 10:59:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-ec7881f8-f796-43aa-9140-bb3e0450394a req-b1f83f95-8a65-4997-a64d-1b1a0a52a8d5 service nova] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Detach interface failed, port_id=346d37bb-4749-43ab-b83e-c0472def78b2, reason: Instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 10:59:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-22a49147-91b5-4e57-891f-55e11235fabe req-5c2419d6-b023-4d6a-bb55-bdfe52f3a0f9 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-changed-d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-22a49147-91b5-4e57-891f-55e11235fabe req-5c2419d6-b023-4d6a-bb55-bdfe52f3a0f9 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing instance network info cache due to event network-changed-d300f067-441e-4d3b-a83a-f7eddbcb58fc. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:59:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-22a49147-91b5-4e57-891f-55e11235fabe req-5c2419d6-b023-4d6a-bb55-bdfe52f3a0f9 service nova] Acquiring lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:59:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-22a49147-91b5-4e57-891f-55e11235fabe req-5c2419d6-b023-4d6a-bb55-bdfe52f3a0f9 service nova] Acquired lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:59:30 user nova-compute[74278]: DEBUG nova.network.neutron [req-22a49147-91b5-4e57-891f-55e11235fabe req-5c2419d6-b023-4d6a-bb55-bdfe52f3a0f9 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Refreshing network info cache for port d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:59:30 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:59:30 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:59:30 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=6928MB free_disk=24.910717010498047GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 10:59:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 55cf7cd9-4e0b-4caa-874e-4963079e3b10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 5ed94499-397a-4dc4-94da-13eb67312572 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance f5fec1d4-833e-44db-8226-795fd62b18d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance d6bdec9e-b5dc-483d-b89e-ece814c92e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a6ad2df0-d37c-43f8-bb93-1fb3894b4593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 64287717-7d3b-4087-aedf-faf87be774a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2b8efca4-cec4-4179-99af-92172f9b8a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 10:59:31 user nova-compute[74278]: INFO nova.compute.manager [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] [instance: 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d] Took 1.05 seconds to detach 1 volumes for instance.
Oct 30 10:59:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.750s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.423s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:32 user nova-compute[74278]: DEBUG nova.network.neutron [req-22a49147-91b5-4e57-891f-55e11235fabe req-5c2419d6-b023-4d6a-bb55-bdfe52f3a0f9 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updated VIF entry in instance network info cache for port d300f067-441e-4d3b-a83a-f7eddbcb58fc. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:59:32 user nova-compute[74278]: DEBUG nova.network.neutron [req-22a49147-91b5-4e57-891f-55e11235fabe req-5c2419d6-b023-4d6a-bb55-bdfe52f3a0f9 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating instance_info_cache with network_info: [{"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "address": "fa:16:3e:85:da:01", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d26599a-8a", "ovs_interfaceid": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e898cb36-b040-4316-b0e2-9d6af4724592", "address": "fa:16:3e:f7:70:58", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape898cb36-b0", "ovs_interfaceid": "e898cb36-b040-4316-b0e2-9d6af4724592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-22a49147-91b5-4e57-891f-55e11235fabe req-5c2419d6-b023-4d6a-bb55-bdfe52f3a0f9 service nova] Releasing lock "refresh_cache-f5fec1d4-833e-44db-8226-795fd62b18d8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:59:32 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:59:32 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:59:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:32 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Deleted allocations for instance 25c5ad55-f85b-4371-8bdf-95a6a0f4d73d
Oct 30 10:59:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d9eb1adc-8b90-464e-8d8f-992377ee9efd tempest-ServerActionsTestOtherB-1708015848 tempest-ServerActionsTestOtherB-1708015848-project-member] Lock "25c5ad55-f85b-4371-8bdf-95a6a0f4d73d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.952s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:32 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:59:32 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 10:59:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-55cf7cd9-4e0b-4caa-874e-4963079e3b10" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:59:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-55cf7cd9-4e0b-4caa-874e-4963079e3b10" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:59:32 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Updating instance_info_cache with network_info: [{"id": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "address": "fa:16:3e:59:01:36", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3e969f-e9", "ovs_interfaceid": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG nova.compute.manager [req-2d0ba68f-9a9c-4cbd-9ff8-d88a46bfc783 req-323480e3-0a8a-4836-bfc0-c420aa1c1af4 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Received event network-changed-f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG nova.compute.manager [req-2d0ba68f-9a9c-4cbd-9ff8-d88a46bfc783 req-323480e3-0a8a-4836-bfc0-c420aa1c1af4 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Refreshing instance network info cache due to event network-changed-f98897ed-9d97-41d1-8bd0-257b57595656. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2d0ba68f-9a9c-4cbd-9ff8-d88a46bfc783 req-323480e3-0a8a-4836-bfc0-c420aa1c1af4 service nova] Acquiring lock "refresh_cache-d6bdec9e-b5dc-483d-b89e-ece814c92e42" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2d0ba68f-9a9c-4cbd-9ff8-d88a46bfc783 req-323480e3-0a8a-4836-bfc0-c420aa1c1af4 service nova] Acquired lock "refresh_cache-d6bdec9e-b5dc-483d-b89e-ece814c92e42" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG nova.network.neutron [req-2d0ba68f-9a9c-4cbd-9ff8-d88a46bfc783 req-323480e3-0a8a-4836-bfc0-c420aa1c1af4 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Refreshing network info cache for port f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-55cf7cd9-4e0b-4caa-874e-4963079e3b10" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:33 user nova-compute[74278]: INFO nova.compute.manager [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Terminating instance
Oct 30 10:59:33 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG nova.network.neutron [req-2d0ba68f-9a9c-4cbd-9ff8-d88a46bfc783 req-323480e3-0a8a-4836-bfc0-c420aa1c1af4 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Updated VIF entry in instance network info cache for port f98897ed-9d97-41d1-8bd0-257b57595656. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG nova.network.neutron [req-2d0ba68f-9a9c-4cbd-9ff8-d88a46bfc783 req-323480e3-0a8a-4836-bfc0-c420aa1c1af4 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Updating instance_info_cache with network_info: [{"id": "f98897ed-9d97-41d1-8bd0-257b57595656", "address": "fa:16:3e:fd:9f:c7", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98897ed-9d", "ovs_interfaceid": "f98897ed-9d97-41d1-8bd0-257b57595656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2d0ba68f-9a9c-4cbd-9ff8-d88a46bfc783 req-323480e3-0a8a-4836-bfc0-c420aa1c1af4 service nova] Releasing lock "refresh_cache-d6bdec9e-b5dc-483d-b89e-ece814c92e42" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG nova.compute.manager [req-978b6052-6476-4f54-989f-40092a15deb2 req-77e8914d-0e79-4fcb-8ea3-5a36acaece0c service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-unplugged-b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-978b6052-6476-4f54-989f-40092a15deb2 req-77e8914d-0e79-4fcb-8ea3-5a36acaece0c service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-978b6052-6476-4f54-989f-40092a15deb2 req-77e8914d-0e79-4fcb-8ea3-5a36acaece0c service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-978b6052-6476-4f54-989f-40092a15deb2 req-77e8914d-0e79-4fcb-8ea3-5a36acaece0c service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG nova.compute.manager [req-978b6052-6476-4f54-989f-40092a15deb2 req-77e8914d-0e79-4fcb-8ea3-5a36acaece0c service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-unplugged-b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG nova.compute.manager [req-978b6052-6476-4f54-989f-40092a15deb2 req-77e8914d-0e79-4fcb-8ea3-5a36acaece0c service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-unplugged-b92be7d7-88bb-45e4-b5b8-94d127ad295f for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Instance destroyed successfully.
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.objects.instance [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lazy-loading 'resources' on Instance uuid f5fec1d4-833e-44db-8226-795fd62b18d8 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:fc:3d,bridge_name='br-int',has_traffic_filtering=True,id=d300f067-441e-4d3b-a83a-f7eddbcb58fc,network=Network(0f0be984-c96c-43a4-b9b1-20765fd1279a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd300f067-44') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:fc:3d,bridge_name='br-int',has_traffic_filtering=True,id=d300f067-441e-4d3b-a83a-f7eddbcb58fc,network=Network(0f0be984-c96c-43a4-b9b1-20765fd1279a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd300f067-44') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd300f067-44, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-unplugged-e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-unplugged-e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-unplugged-e90182c7-f21f-4f96-88de-46c9272e577e for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:35 user nova-compute[74278]: WARNING nova.compute.manager [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-e90182c7-f21f-4f96-88de-46c9272e577e for instance with vm_state active and task_state deleting.
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-unplugged-e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-unplugged-e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-unplugged-e898cb36-b040-4316-b0e2-9d6af4724592 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:35 user nova-compute[74278]: WARNING nova.compute.manager [req-bc676cf1-75bb-4b64-ac76-5dbb62101ef4 req-9fd2c3bf-42d8-4ea1-b124-665db392887f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-e898cb36-b040-4316-b0e2-9d6af4724592 for instance with vm_state active and task_state deleting.
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4da0623-eaf8-4d20-83ad-fdd8acc9dc07) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: INFO os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:fc:3d,bridge_name='br-int',has_traffic_filtering=True,id=d300f067-441e-4d3b-a83a-f7eddbcb58fc,network=Network(0f0be984-c96c-43a4-b9b1-20765fd1279a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd300f067-44')
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=645e6816-b45e-455b-b558-039baf08d79a,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap645e6816-b4') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=645e6816-b45e-455b-b558-039baf08d79a,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap645e6816-b4') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap645e6816-b4, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d26a52c-8c5b-4615-8b3d-78b7b98c864b) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: INFO os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:b3:c6,bridge_name='br-int',has_traffic_filtering=True,id=645e6816-b45e-455b-b558-039baf08d79a,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap645e6816-b4')
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:df:d1,bridge_name='br-int',has_traffic_filtering=True,id=487a7419-c1b7-4d9f-81a0-b52e76795926,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap487a7419-c1') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:df:d1,bridge_name='br-int',has_traffic_filtering=True,id=487a7419-c1b7-4d9f-81a0-b52e76795926,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap487a7419-c1') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap487a7419-c1, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=607bd2be-15db-45ab-baef-f3aa82072197) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: INFO os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:df:d1,bridge_name='br-int',has_traffic_filtering=True,id=487a7419-c1b7-4d9f-81a0-b52e76795926,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap487a7419-c1')
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:0a:29,bridge_name='br-int',has_traffic_filtering=True,id=b92be7d7-88bb-45e4-b5b8-94d127ad295f,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92be7d7-88') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:0a:29,bridge_name='br-int',has_traffic_filtering=True,id=b92be7d7-88bb-45e4-b5b8-94d127ad295f,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92be7d7-88') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb92be7d7-88, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=151054d2-e997-482b-bd12-064b3a909101) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] swap_volume: Updating volume 6a5f0606-50af-4c7c-82dc-876d226675bd BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "MnAfdErK", "auth_password": "8bmVOj7MDS3aGp", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0"}, "status": "reserved", "instance": "5ed94499-397a-4dc4-94da-13eb67312572", "attached_at": "", "detached_at": "", "volume_id": "adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0", "serial": "adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0', 'no_device': None, 'attachment_id': '9ca50a8f-694b-4e8b-a8f4-e52e4e83e9ec'} {{(pid=74278) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: INFO os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:0a:29,bridge_name='br-int',has_traffic_filtering=True,id=b92be7d7-88bb-45e4-b5b8-94d127ad295f,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb92be7d7-88')
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "address": "fa:16:3e:85:da:01", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d26599a-8a", "ovs_interfaceid": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "address": "fa:16:3e:85:da:01", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d26599a-8a", "ovs_interfaceid": "0d26599a-8ac3-408a-b67c-d1d9041e3d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:da:01,bridge_name='br-int',has_traffic_filtering=True,id=0d26599a-8ac3-408a-b67c-d1d9041e3d72,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d26599a-8a') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:da:01,bridge_name='br-int',has_traffic_filtering=True,id=0d26599a-8ac3-408a-b67c-d1d9041e3d72,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d26599a-8a') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b2dec92c-d4f7-4bc5-ade7-8605978c39d5 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "5ed94499-397a-4dc4-94da-13eb67312572" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 44.167s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d26599a-8a, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2648c39a-3cbf-4766-a301-3a4f314e124d) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: INFO os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:da:01,bridge_name='br-int',has_traffic_filtering=True,id=0d26599a-8ac3-408a-b67c-d1d9041e3d72,network=Network(c27e7401-b133-45be-97be-68ae5930e98e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d26599a-8a')
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e90182c7-f21f-4f96-88de-46c9272e577e,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90182c7-f2') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e90182c7-f21f-4f96-88de-46c9272e577e,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90182c7-f2') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape90182c7-f2, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ab3e169-a446-4ffe-a312-7d1ef4a3686e) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: INFO os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:5c:19,bridge_name='br-int',has_traffic_filtering=True,id=e90182c7-f21f-4f96-88de-46c9272e577e,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape90182c7-f2')
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T10:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912409533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1912409533',id=18,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8IbYJABokhJZORdZ260E3qQlsuDJ6FXAMswZUki2z1txNIPvbOomw7rlUtQVbtMOh/6ycUmTdZePEg3zCsY4Pw0kiclGAH1tGENkdYgWCB5BSM7M81P4X/qYUCv7ocuA==',key_name='tempest-keypair-252316072',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:58:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a202f3c5f6c422e91e843f803dc142c',ramdisk_id='',reservation_id='r-tg2kr20w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-993466353',owner_user_name='tempest-TaggedBootDevicesTest_v242-993466353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ab29f4448114abc9456799a794b6b57',uuid=f5fec1d4-833e-44db-8226-795fd62b18d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e898cb36-b040-4316-b0e2-9d6af4724592", "address": "fa:16:3e:f7:70:58", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape898cb36-b0", "ovs_interfaceid": "e898cb36-b040-4316-b0e2-9d6af4724592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converting VIF {"id": "e898cb36-b040-4316-b0e2-9d6af4724592", "address": "fa:16:3e:f7:70:58", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape898cb36-b0", "ovs_interfaceid": "e898cb36-b040-4316-b0e2-9d6af4724592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:70:58,bridge_name='br-int',has_traffic_filtering=True,id=e898cb36-b040-4316-b0e2-9d6af4724592,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape898cb36-b0') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:70:58,bridge_name='br-int',has_traffic_filtering=True,id=e898cb36-b040-4316-b0e2-9d6af4724592,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape898cb36-b0') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape898cb36-b0, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7ddd044-574e-4bce-9711-c4d840d2c561) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:36 user nova-compute[74278]: INFO os_vif [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:70:58,bridge_name='br-int',has_traffic_filtering=True,id=e898cb36-b040-4316-b0e2-9d6af4724592,network=Network(01d89039-88eb-48a6-a2f1-454e86c892ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape898cb36-b0')
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tGDHAbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:59:36 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97c7fa0-80d4-4d47-8b67-d611646ae926]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:59:36 user nova-compute[74278]: No targets found.
Oct 30 10:59:36 user nova-compute[74278]: iSNS:
Oct 30 10:59:36 user nova-compute[74278]: No targets found.
Oct 30 10:59:36 user nova-compute[74278]: STATIC:
Oct 30 10:59:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0
Oct 30 10:59:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80
Oct 30 10:59:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39
Oct 30 10:59:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1
Oct 30 10:59:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9
Oct 30 10:59:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:59:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:36 user nova-compute[74278]: FIRMWARE:
Oct 30 10:59:36 user nova-compute[74278]: No targets found.
Oct 30 10:59:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:59:36 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:59:36 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf57f25-c245-4cdf-a8c3-fa82a57c17f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ab4dbe-d5b9-4968-8fbb-01a40407b94f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac26d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f001cc8-80f4-4c13-9e65-3651f67fb9a3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fca26ef-f0d3-4ed1-98c5-34a054dd110c]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cca4948-c766-4f3b-ba8b-b939a41813fe]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bec19e8-86e9-4559-8249-defb792a202f]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:36 user nova-compute[74278]: WARNING nova.compute.manager [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-b92be7d7-88bb-45e4-b5b8-94d127ad295f for instance with vm_state active and task_state deleting.
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-unplugged-0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-unplugged-0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-unplugged-0d26599a-8ac3-408a-b67c-d1d9041e3d72 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:36 user nova-compute[74278]: WARNING nova.compute.manager [req-21f330bb-3118-46dd-8b8a-bd34919e0529 req-7e0dfae7-072b-4f01-8116-85574043bb6f service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-0d26599a-8ac3-408a-b67c-d1d9041e3d72 for instance with vm_state active and task_state deleting.
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8d0de5-692a-43e4-ab4b-6516513fc679]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2050a0fb-e068-4439-b63b-ed16f04a4453]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80, portal: 172.16.0.220,3260]
Oct 30 10:59:36 user nova-compute[74278]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80, portal: 172.16.0.220,3260] successful.
Oct 30 10:59:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b566a64a-aadb-4270-8fe4-b3599498df80 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[039c18b5-521e-42f7-a824-7fdbb7efeab8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] <== disconnect_volume: return (421ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jDQBLtvV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:59:36 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9731eeae-36b2-4f64-8ac1-064dc73f1066]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:59:36 user nova-compute[74278]: No targets found.
Oct 30 10:59:36 user nova-compute[74278]: iSNS:
Oct 30 10:59:36 user nova-compute[74278]: No targets found.
Oct 30 10:59:36 user nova-compute[74278]: STATIC:
Oct 30 10:59:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0
Oct 30 10:59:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39
Oct 30 10:59:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1
Oct 30 10:59:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9
Oct 30 10:59:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:59:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:36 user nova-compute[74278]: FIRMWARE:
Oct 30 10:59:36 user nova-compute[74278]: No targets found.
Oct 30 10:59:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:59:36 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:59:36 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ed313c-beac-4cd4-86ef-8ba3b38aa53e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c95100-18c8-4dc6-9ec8-58d5239a9cbe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 10:59:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac26d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9'): ({'sde'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Removing single pathed devices sde {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78e7dd8-8035-4d5b-9a2e-793464334059]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6ad2d7-8aec-4902-a816-d1526c74cc29]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Flushing IO for device /dev/sde {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ae7bff-4e83-4817-9d24-c2fdbf2a0b3b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aa1bd1-4b37-4bc3-8931-20c6acebf106]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] SCSI volumes sde have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a7781a-4a65-41d0-890a-d146e20dfc06]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[587d921d-e5a2-4f37-9906-a3e16bc744ee]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9, portal: 172.16.0.220,3260]
Oct 30 10:59:37 user nova-compute[74278]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9, portal: 172.16.0.220,3260] successful.
Oct 30 10:59:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f0b5fa84-3517-4e41-999f-b8cfb51e56d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b078541a-2431-40c0-9249-d69710718048]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] <== disconnect_volume: return (388ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlCAXGnE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:59:37 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d0c2c2-97e7-458a-9f4f-35832111a5d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 10:59:37 user nova-compute[74278]: No targets found.
Oct 30 10:59:37 user nova-compute[74278]: iSNS:
Oct 30 10:59:37 user nova-compute[74278]: No targets found.
Oct 30 10:59:37 user nova-compute[74278]: STATIC:
Oct 30 10:59:37 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0
Oct 30 10:59:37 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:37 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:37 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39
Oct 30 10:59:37 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:37 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:37 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1
Oct 30 10:59:37 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:37 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:37 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 10:59:37 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 10:59:37 user nova-compute[74278]:                 Iface Name: default
Oct 30 10:59:37 user nova-compute[74278]: FIRMWARE:
Oct 30 10:59:37 user nova-compute[74278]: No targets found.
Oct 30 10:59:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 10:59:37 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 10:59:37 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbd6325-fec1-48e5-9e7f-5544c464c77a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7923112-6079-41ce-b91e-88c2acab0b96]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:37 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:37 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:37 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 10:59:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 10:59:37 user nova-compute[74278]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 (non-flash)
Oct 30 10:59:37 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 10:59:37 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 10:59:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac26d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39'): ({'sdg'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Removing single pathed devices sdg {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce6ce29-3536-4b6a-af4b-b11a836ff498]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3182be4-d211-4669-b008-2fcb035fed1d]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Flushing IO for device /dev/sdg {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[07be6f02-f605-4bf7-875a-1a18f27c502b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "5ed94499-397a-4dc4-94da-13eb67312572" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.utils [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.061s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b3c5d4-5862-4107-a2da-e5173e6ac635]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] SCSI volumes sdg have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7806c02a-c0b0-46cd-9e52-c9307efc2f9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffc26da-f145-4599-ac6a-7c8b162ac630]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.043s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[668e5438-f9b4-4c7d-b46f-37b52c149afe]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[feef8f0e-aed9-44c9-8616-a3675dda1c01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1d1434-7357-4ba1-b0da-0bb77e814228]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c95b46-6ed2-49f6-ad38-b7ca4c703a2c]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39, portal: 172.16.0.220,3260]
Oct 30 10:59:37 user nova-compute[74278]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39, portal: 172.16.0.220,3260] successful.
Oct 30 10:59:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:59:37 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbc21e8-9ece-4aff-8135-4889a6cef476]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.utils [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51111d83-06f8-4619-83bc-ada1b2363b39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[958dc191-dbd8-4817-91d3-84a27eb09c56]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] <== disconnect_volume: return (427ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 10:59:37 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Deleting instance files /opt/stack/data/nova/instances/f5fec1d4-833e-44db-8226-795fd62b18d8_del
Oct 30 10:59:37 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Deletion of /opt/stack/data/nova/instances/f5fec1d4-833e-44db-8226-795fd62b18d8_del complete
Oct 30 10:59:37 user nova-compute[74278]: INFO nova.compute.manager [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Took 4.01 seconds to destroy the instance on the hypervisor.
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:59:37 user nova-compute[74278]: INFO nova.compute.manager [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Swapping volume adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 for 6a5f0606-50af-4c7c-82dc-876d226675bd
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:37 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 10:59:37 user nova-compute[74278]: INFO nova.compute.claims [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Claim successful on node user
Oct 30 10:59:38 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:59:38 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:59:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.715s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:38 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 10:59:38 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 10:59:38 user nova-compute[74278]: DEBUG nova.network.neutron [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 10:59:38 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 10:59:38 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 10:59:38 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 10:59:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 10:59:38 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Creating image(s)
Oct 30 10:59:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "/opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "/opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "/opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:38 user nova-compute[74278]: DEBUG nova.policy [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4c1fb22bbcf4405b0b9da85475494a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2474a648f3b48ac9a43b07b77f9d6e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 10:59:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.193s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk 1073741824" returned: 0 in 0.052s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.274s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Cannot resize image /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Ensure instance console log exists: /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG nova.compute.manager [req-c2604e79-d1d1-4dee-9c8e-56b0a99116e1 req-f270aa74-783c-4002-b3f1-835144f48dd0 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-unplugged-d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c2604e79-d1d1-4dee-9c8e-56b0a99116e1 req-f270aa74-783c-4002-b3f1-835144f48dd0 service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c2604e79-d1d1-4dee-9c8e-56b0a99116e1 req-f270aa74-783c-4002-b3f1-835144f48dd0 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c2604e79-d1d1-4dee-9c8e-56b0a99116e1 req-f270aa74-783c-4002-b3f1-835144f48dd0 service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG nova.compute.manager [req-c2604e79-d1d1-4dee-9c8e-56b0a99116e1 req-f270aa74-783c-4002-b3f1-835144f48dd0 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-unplugged-d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:39 user nova-compute[74278]: DEBUG nova.compute.manager [req-c2604e79-d1d1-4dee-9c8e-56b0a99116e1 req-f270aa74-783c-4002-b3f1-835144f48dd0 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-unplugged-d300f067-441e-4d3b-a83a-f7eddbcb58fc for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG nova.objects.instance [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'flavor' on Instance uuid d6bdec9e-b5dc-483d-b89e-ece814c92e42 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG nova.network.neutron [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Successfully created port: 42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:40 user nova-compute[74278]: INFO nova.compute.manager [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Attaching volume 86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 to /dev/vdb
Oct 30 10:59:40 user nova-compute[74278]: DEBUG os_brick.utils [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2b45ca-38e2-4995-9334-d8d4b67351c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e44794-26ba-4106-a790-52f9b100b64b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[af325501-8efd-4135-a195-875c4ef662a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b61515-440b-4983-b8d0-830a4119a851]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 10:59:41 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 10:59:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ced708-edf9-4388-9af6-eb684e360ec4]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG os_brick.utils [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Updating existing volume attachment record: d19e3bb0-f86b-4d3c-bf18-412bb19f3811 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-plugged-d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] Acquiring lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] No waiting events found dispatching network-vif-plugged-d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:41 user nova-compute[74278]: WARNING nova.compute.manager [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received unexpected event network-vif-plugged-d300f067-441e-4d3b-a83a-f7eddbcb58fc for instance with vm_state active and task_state deleting.
Oct 30 10:59:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-deleted-0d26599a-8ac3-408a-b67c-d1d9041e3d72 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:41 user nova-compute[74278]: INFO nova.compute.manager [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Neutron deleted interface 0d26599a-8ac3-408a-b67c-d1d9041e3d72; detaching it from the instance and deleting it from the info cache
Oct 30 10:59:41 user nova-compute[74278]: DEBUG nova.network.neutron [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating instance_info_cache with network_info: [{"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e898cb36-b040-4316-b0e2-9d6af4724592", "address": "fa:16:3e:f7:70:58", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape898cb36-b0", "ovs_interfaceid": "e898cb36-b040-4316-b0e2-9d6af4724592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:41 user nova-compute[74278]: INFO nova.compute.manager [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Terminating instance
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.compute.manager [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Detach interface failed, port_id=0d26599a-8ac3-408a-b67c-d1d9041e3d72, reason: Instance f5fec1d4-833e-44db-8226-795fd62b18d8 could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-deleted-e898cb36-b040-4316-b0e2-9d6af4724592 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:42 user nova-compute[74278]: INFO nova.compute.manager [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Neutron deleted interface e898cb36-b040-4316-b0e2-9d6af4724592; detaching it from the instance and deleting it from the info cache
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.network.neutron [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating instance_info_cache with network_info: [{"id": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "address": "fa:16:3e:0e:fc:3d", "network": {"id": "0f0be984-c96c-43a4-b9b1-20765fd1279a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-616671850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd300f067-44", "ovs_interfaceid": "d300f067-441e-4d3b-a83a-f7eddbcb58fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "645e6816-b45e-455b-b558-039baf08d79a", "address": "fa:16:3e:13:b3:c6", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645e6816-b4", "ovs_interfaceid": "645e6816-b45e-455b-b558-039baf08d79a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "487a7419-c1b7-4d9f-81a0-b52e76795926", "address": "fa:16:3e:c4:df:d1", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487a7419-c1", "ovs_interfaceid": "487a7419-c1b7-4d9f-81a0-b52e76795926", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "address": "fa:16:3e:fe:0a:29", "network": {"id": "c27e7401-b133-45be-97be-68ae5930e98e", "bridge": "br-int", "label": "tempest-device-tagging-net1-603484584", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb92be7d7-88", "ovs_interfaceid": "b92be7d7-88bb-45e4-b5b8-94d127ad295f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e90182c7-f21f-4f96-88de-46c9272e577e", "address": "fa:16:3e:e3:5c:19", "network": {"id": "01d89039-88eb-48a6-a2f1-454e86c892ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-1816203256", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a202f3c5f6c422e91e843f803dc142c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape90182c7-f2", "ovs_interfaceid": "e90182c7-f21f-4f96-88de-46c9272e577e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-86ca3008-3084-4819-84c2-edb397169445 req-9e5ab28f-f214-4ffb-854d-db1ea3a96fdb service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Detach interface failed, port_id=e898cb36-b040-4316-b0e2-9d6af4724592, reason: Instance f5fec1d4-833e-44db-8226-795fd62b18d8 could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.network.neutron [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Successfully updated port: 42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "refresh_cache-23852f7e-6e4a-4e19-91ff-d9914c04cf83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquired lock "refresh_cache-23852f7e-6e4a-4e19-91ff-d9914c04cf83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.network.neutron [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.network.neutron [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 10:59:42 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Instance destroyed successfully.
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lazy-loading 'resources' on Instance uuid 55cf7cd9-4e0b-4caa-874e-4963079e3b10 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-660921308',display_name='tempest-ServersNegativeTestJSON-server-660921308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-660921308',id=3,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad83f3fea7fc4f308278ab8be165e86b',ramdisk_id='',reservation_id='r-9f350mht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1521565055',owner_user_name='tempest-ServersNegativeTestJSON-1521565055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:50:38Z,user_data=None,user_id='fa0d70bee1b64b939678aec53d77c0fd',uuid=55cf7cd9-4e0b-4caa-874e-4963079e3b10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "address": "fa:16:3e:59:01:36", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3e969f-e9", "ovs_interfaceid": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Converting VIF {"id": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "address": "fa:16:3e:59:01:36", "network": {"id": "ff5fdcea-6aa3-4076-88c4-cb211be06e1d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2103626499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad83f3fea7fc4f308278ab8be165e86b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf3e969f-e9", "ovs_interfaceid": "af3e969f-e92f-4ae0-ab01-343c78c675b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:01:36,bridge_name='br-int',has_traffic_filtering=True,id=af3e969f-e92f-4ae0-ab01-343c78c675b0,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3e969f-e9') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG os_vif [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:01:36,bridge_name='br-int',has_traffic_filtering=True,id=af3e969f-e92f-4ae0-ab01-343c78c675b0,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3e969f-e9') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf3e969f-e9, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=595ddef8-e1ee-4298-a4f8-b7b6b9c6a9e0) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:42 user nova-compute[74278]: INFO os_vif [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:01:36,bridge_name='br-int',has_traffic_filtering=True,id=af3e969f-e92f-4ae0-ab01-343c78c675b0,network=Network(ff5fdcea-6aa3-4076-88c4-cb211be06e1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf3e969f-e9')
Oct 30 10:59:42 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Deleting instance files /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10_del
Oct 30 10:59:42 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Deletion of /opt/stack/data/nova/instances/55cf7cd9-4e0b-4caa-874e-4963079e3b10_del complete
Oct 30 10:59:42 user nova-compute[74278]: INFO nova.compute.manager [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 30 10:59:42 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.network.neutron [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Updating instance_info_cache with network_info: [{"id": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "address": "fa:16:3e:37:3e:a6", "network": {"id": "e3277ec0-08f4-4186-8b28-31a9c9112aac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1499901778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2474a648f3b48ac9a43b07b77f9d6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42f486b0-bb", "ovs_interfaceid": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Releasing lock "refresh_cache-23852f7e-6e4a-4e19-91ff-d9914c04cf83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Instance network_info: |[{"id": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "address": "fa:16:3e:37:3e:a6", "network": {"id": "e3277ec0-08f4-4186-8b28-31a9c9112aac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1499901778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2474a648f3b48ac9a43b07b77f9d6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42f486b0-bb", "ovs_interfaceid": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Start _get_guest_xml network_info=[{"id": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "address": "fa:16:3e:37:3e:a6", "network": {"id": "e3277ec0-08f4-4186-8b28-31a9c9112aac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1499901778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2474a648f3b48ac9a43b07b77f9d6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42f486b0-bb", "ovs_interfaceid": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 10:59:42 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:59:42 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-376650337',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-376650337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3766503',id=24,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxqVcC4a3t7e5BnTNviY7fJgqWMeeNHqVK+jDq5sL2KqzDzSBJVA9+WioK1LY+nL95vZLaFOgaPeaOxVgwMcvUzBSRKuR7ctzOw6nX3Z0ycXKd5oQJAzf2ryyxfm1LYKQ==',key_name='tempest-keypair-587155817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2474a648f3b48ac9a43b07b77f9d6e4',ramdisk_id='',reservation_id='r-o1seeb1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1692465110',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:59:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4c1fb22bbcf4405b0b9da85475494a4',uuid=23852f7e-6e4a-4e19-91ff-d9914c04cf83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "address": "fa:16:3e:37:3e:a6", "network": {"id": "e3277ec0-08f4-4186-8b28-31a9c9112aac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1499901778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2474a648f3b48ac9a43b07b77f9d6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42f486b0-bb", "ovs_interfaceid": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Converting VIF {"id": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "address": "fa:16:3e:37:3e:a6", "network": {"id": "e3277ec0-08f4-4186-8b28-31a9c9112aac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1499901778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2474a648f3b48ac9a43b07b77f9d6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42f486b0-bb", "ovs_interfaceid": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=42f486b0-bbf0-41a3-b93a-1647f97bf631,network=Network(e3277ec0-08f4-4186-8b28-31a9c9112aac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42f486b0-bb') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:42 user nova-compute[74278]: DEBUG nova.objects.instance [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lazy-loading 'pci_devices' on Instance uuid 23852f7e-6e4a-4e19-91ff-d9914c04cf83 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] End _get_guest_xml xml=<domain type="kvm">
Oct 30 10:59:43 user nova-compute[74278]:   <uuid>23852f7e-6e4a-4e19-91ff-d9914c04cf83</uuid>
Oct 30 10:59:43 user nova-compute[74278]:   <name>instance-00000018</name>
Oct 30 10:59:43 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 10:59:43 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 10:59:43 user nova-compute[74278]:   <metadata>
Oct 30 10:59:43 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 10:59:43 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 10:59:43 user nova-compute[74278]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-376650337</nova:name>
Oct 30 10:59:43 user nova-compute[74278]:       <nova:creationTime>2023-10-30 10:59:42</nova:creationTime>
Oct 30 10:59:43 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 10:59:43 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 10:59:43 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 10:59:43 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 10:59:43 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 10:59:43 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 10:59:43 user nova-compute[74278]:       </nova:flavor>
Oct 30 10:59:43 user nova-compute[74278]:       <nova:owner>
Oct 30 10:59:43 user nova-compute[74278]:         <nova:user uuid="c4c1fb22bbcf4405b0b9da85475494a4">tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member</nova:user>
Oct 30 10:59:43 user nova-compute[74278]:         <nova:project uuid="c2474a648f3b48ac9a43b07b77f9d6e4">tempest-TestServerVolumeAttachScenarioOldVersion-1692465110</nova:project>
Oct 30 10:59:43 user nova-compute[74278]:       </nova:owner>
Oct 30 10:59:43 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 10:59:43 user nova-compute[74278]:       <nova:ports>
Oct 30 10:59:43 user nova-compute[74278]:         <nova:port uuid="42f486b0-bbf0-41a3-b93a-1647f97bf631">
Oct 30 10:59:43 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 10:59:43 user nova-compute[74278]:         </nova:port>
Oct 30 10:59:43 user nova-compute[74278]:       </nova:ports>
Oct 30 10:59:43 user nova-compute[74278]:     </nova:instance>
Oct 30 10:59:43 user nova-compute[74278]:   </metadata>
Oct 30 10:59:43 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 10:59:43 user nova-compute[74278]:     <system>
Oct 30 10:59:43 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 10:59:43 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 10:59:43 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 10:59:43 user nova-compute[74278]:       <entry name="serial">23852f7e-6e4a-4e19-91ff-d9914c04cf83</entry>
Oct 30 10:59:43 user nova-compute[74278]:       <entry name="uuid">23852f7e-6e4a-4e19-91ff-d9914c04cf83</entry>
Oct 30 10:59:43 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 10:59:43 user nova-compute[74278]:     </system>
Oct 30 10:59:43 user nova-compute[74278]:   </sysinfo>
Oct 30 10:59:43 user nova-compute[74278]:   <os>
Oct 30 10:59:43 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 10:59:43 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 10:59:43 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 10:59:43 user nova-compute[74278]:   </os>
Oct 30 10:59:43 user nova-compute[74278]:   <features>
Oct 30 10:59:43 user nova-compute[74278]:     <acpi/>
Oct 30 10:59:43 user nova-compute[74278]:     <apic/>
Oct 30 10:59:43 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 10:59:43 user nova-compute[74278]:   </features>
Oct 30 10:59:43 user nova-compute[74278]:   <clock offset="utc">
Oct 30 10:59:43 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 10:59:43 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 10:59:43 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 10:59:43 user nova-compute[74278]:   </clock>
Oct 30 10:59:43 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 10:59:43 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 10:59:43 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 10:59:43 user nova-compute[74278]:   </cpu>
Oct 30 10:59:43 user nova-compute[74278]:   <devices>
Oct 30 10:59:43 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 10:59:43 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 10:59:43 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk"/>
Oct 30 10:59:43 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 10:59:43 user nova-compute[74278]:     </disk>
Oct 30 10:59:43 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 10:59:43 user nova-compute[74278]:       <mac address="fa:16:3e:37:3e:a6"/>
Oct 30 10:59:43 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:59:43 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 10:59:43 user nova-compute[74278]:       <target dev="tap42f486b0-bb"/>
Oct 30 10:59:43 user nova-compute[74278]:     </interface>
Oct 30 10:59:43 user nova-compute[74278]:     <serial type="pty">
Oct 30 10:59:43 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/console.log" append="off"/>
Oct 30 10:59:43 user nova-compute[74278]:     </serial>
Oct 30 10:59:43 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 10:59:43 user nova-compute[74278]:     <video>
Oct 30 10:59:43 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 10:59:43 user nova-compute[74278]:     </video>
Oct 30 10:59:43 user nova-compute[74278]:     <rng model="virtio">
Oct 30 10:59:43 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 10:59:43 user nova-compute[74278]:     </rng>
Oct 30 10:59:43 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 10:59:43 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 10:59:43 user nova-compute[74278]:       <stats period="10"/>
Oct 30 10:59:43 user nova-compute[74278]:     </memballoon>
Oct 30 10:59:43 user nova-compute[74278]:   </devices>
Oct 30 10:59:43 user nova-compute[74278]: </domain>
Oct 30 10:59:43 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-376650337',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-376650337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3766503',id=24,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxqVcC4a3t7e5BnTNviY7fJgqWMeeNHqVK+jDq5sL2KqzDzSBJVA9+WioK1LY+nL95vZLaFOgaPeaOxVgwMcvUzBSRKuR7ctzOw6nX3Z0ycXKd5oQJAzf2ryyxfm1LYKQ==',key_name='tempest-keypair-587155817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2474a648f3b48ac9a43b07b77f9d6e4',ramdisk_id='',reservation_id='r-o1seeb1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1692465110',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T10:59:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4c1fb22bbcf4405b0b9da85475494a4',uuid=23852f7e-6e4a-4e19-91ff-d9914c04cf83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "address": "fa:16:3e:37:3e:a6", "network": {"id": "e3277ec0-08f4-4186-8b28-31a9c9112aac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1499901778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2474a648f3b48ac9a43b07b77f9d6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42f486b0-bb", "ovs_interfaceid": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Converting VIF {"id": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "address": "fa:16:3e:37:3e:a6", "network": {"id": "e3277ec0-08f4-4186-8b28-31a9c9112aac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1499901778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2474a648f3b48ac9a43b07b77f9d6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42f486b0-bb", "ovs_interfaceid": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=42f486b0-bbf0-41a3-b93a-1647f97bf631,network=Network(e3277ec0-08f4-4186-8b28-31a9c9112aac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42f486b0-bb') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG os_vif [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=42f486b0-bbf0-41a3-b93a-1647f97bf631,network=Network(e3277ec0-08f4-4186-8b28-31a9c9112aac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42f486b0-bb') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42404538-1341-586f-9b94-956c528ea89b', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42f486b0-bb, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42f486b0-bb, col_values=(('qos', UUID('4f8fee20-81d8-4a6b-be6e-09a9fb3e9bfa')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42f486b0-bb, col_values=(('external_ids', {'iface-id': '42f486b0-bbf0-41a3-b93a-1647f97bf631', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:3e:a6', 'vm-uuid': '23852f7e-6e4a-4e19-91ff-d9914c04cf83'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:43 user nova-compute[74278]: INFO os_vif [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=42f486b0-bbf0-41a3-b93a-1647f97bf631,network=Network(e3277ec0-08f4-4186-8b28-31a9c9112aac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42f486b0-bb')
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] No VIF found with MAC fa:16:3e:37:3e:a6, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-60924492-bf7f-4b9d-a1bf-a51a38044ecd req-b6525a00-18e0-4ee8-9f73-1ebd081da52e service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Received event network-vif-deleted-af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:43 user nova-compute[74278]: INFO nova.compute.manager [req-60924492-bf7f-4b9d-a1bf-a51a38044ecd req-b6525a00-18e0-4ee8-9f73-1ebd081da52e service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Neutron deleted interface af3e969f-e92f-4ae0-ab01-343c78c675b0; detaching it from the instance and deleting it from the info cache
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.network.neutron [req-60924492-bf7f-4b9d-a1bf-a51a38044ecd req-b6525a00-18e0-4ee8-9f73-1ebd081da52e service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:43 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Took 0.57 seconds to deallocate network for instance.
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-60924492-bf7f-4b9d-a1bf-a51a38044ecd req-b6525a00-18e0-4ee8-9f73-1ebd081da52e service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Detach interface failed, port_id=af3e969f-e92f-4ae0-ab01-343c78c675b0, reason: Instance 55cf7cd9-4e0b-4caa-874e-4963079e3b10 could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 10:59:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.514s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:43 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Deleted allocations for instance 55cf7cd9-4e0b-4caa-874e-4963079e3b10
Oct 30 10:59:43 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:44 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Took 6.41 seconds to deallocate network for instance.
Oct 30 10:59:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e3830cb4-6438-420d-a25d-02f5d8afcc93 tempest-ServersNegativeTestJSON-1521565055 tempest-ServersNegativeTestJSON-1521565055-project-member] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.030s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Received event network-changed-42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Refreshing instance network info cache due to event network-changed-42f486b0-bbf0-41a3-b93a-1647f97bf631. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] Acquiring lock "refresh_cache-23852f7e-6e4a-4e19-91ff-d9914c04cf83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] Acquired lock "refresh_cache-23852f7e-6e4a-4e19-91ff-d9914c04cf83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Refreshing network info cache for port 42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Updated VIF entry in instance network info cache for port 42f486b0-bbf0-41a3-b93a-1647f97bf631. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Updating instance_info_cache with network_info: [{"id": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "address": "fa:16:3e:37:3e:a6", "network": {"id": "e3277ec0-08f4-4186-8b28-31a9c9112aac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1499901778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2474a648f3b48ac9a43b07b77f9d6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42f486b0-bb", "ovs_interfaceid": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] Releasing lock "refresh_cache-23852f7e-6e4a-4e19-91ff-d9914c04cf83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Received event network-vif-unplugged-af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] Acquiring lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] No waiting events found dispatching network-vif-unplugged-af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:44 user nova-compute[74278]: WARNING nova.compute.manager [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Received unexpected event network-vif-unplugged-af3e969f-e92f-4ae0-ab01-343c78c675b0 for instance with vm_state deleted and task_state None.
Oct 30 10:59:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-deleted-d300f067-441e-4d3b-a83a-f7eddbcb58fc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Received event network-vif-plugged-af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] Acquiring lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] Lock "55cf7cd9-4e0b-4caa-874e-4963079e3b10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] No waiting events found dispatching network-vif-plugged-af3e969f-e92f-4ae0-ab01-343c78c675b0 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:44 user nova-compute[74278]: WARNING nova.compute.manager [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: 55cf7cd9-4e0b-4caa-874e-4963079e3b10] Received unexpected event network-vif-plugged-af3e969f-e92f-4ae0-ab01-343c78c675b0 for instance with vm_state deleted and task_state None.
Oct 30 10:59:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-deleted-b92be7d7-88bb-45e4-b5b8-94d127ad295f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-afb5d543-27eb-4ff2-9e1f-f0910019810b req-185125ad-d709-453b-aeb3-05e2709ebad5 service nova] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Received event network-vif-deleted-e90182c7-f21f-4f96-88de-46c9272e577e {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-542ffcdf-bdfe-4d42-b5f7-71596dc062ef req-de8d34e8-f0d4-4872-9c18-64dde7868111 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Received event network-vif-plugged-42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-542ffcdf-bdfe-4d42-b5f7-71596dc062ef req-de8d34e8-f0d4-4872-9c18-64dde7868111 service nova] Acquiring lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-542ffcdf-bdfe-4d42-b5f7-71596dc062ef req-de8d34e8-f0d4-4872-9c18-64dde7868111 service nova] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-542ffcdf-bdfe-4d42-b5f7-71596dc062ef req-de8d34e8-f0d4-4872-9c18-64dde7868111 service nova] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-542ffcdf-bdfe-4d42-b5f7-71596dc062ef req-de8d34e8-f0d4-4872-9c18-64dde7868111 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] No waiting events found dispatching network-vif-plugged-42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:46 user nova-compute[74278]: WARNING nova.compute.manager [req-542ffcdf-bdfe-4d42-b5f7-71596dc062ef req-de8d34e8-f0d4-4872-9c18-64dde7868111 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Received unexpected event network-vif-plugged-42f486b0-bbf0-41a3-b93a-1647f97bf631 for instance with vm_state building and task_state spawning.
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-542ffcdf-bdfe-4d42-b5f7-71596dc062ef req-de8d34e8-f0d4-4872-9c18-64dde7868111 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Received event network-vif-plugged-42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-542ffcdf-bdfe-4d42-b5f7-71596dc062ef req-de8d34e8-f0d4-4872-9c18-64dde7868111 service nova] Acquiring lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-542ffcdf-bdfe-4d42-b5f7-71596dc062ef req-de8d34e8-f0d4-4872-9c18-64dde7868111 service nova] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-542ffcdf-bdfe-4d42-b5f7-71596dc062ef req-de8d34e8-f0d4-4872-9c18-64dde7868111 service nova] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-542ffcdf-bdfe-4d42-b5f7-71596dc062ef req-de8d34e8-f0d4-4872-9c18-64dde7868111 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] No waiting events found dispatching network-vif-plugged-42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 10:59:46 user nova-compute[74278]: WARNING nova.compute.manager [req-542ffcdf-bdfe-4d42-b5f7-71596dc062ef req-de8d34e8-f0d4-4872-9c18-64dde7868111 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Received unexpected event network-vif-plugged-42f486b0-bbf0-41a3-b93a-1647f97bf631 for instance with vm_state building and task_state spawning.
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 10:59:46 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Instance spawned successfully.
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 10:59:46 user nova-compute[74278]: INFO nova.compute.manager [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Took 8.15 seconds to spawn the instance on the hypervisor.
Oct 30 10:59:46 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 10:59:47 user nova-compute[74278]: INFO nova.compute.manager [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Took 9.25 seconds to build instance.
Oct 30 10:59:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ff7b0bd4-e5c6-4f4a-be3f-7527e7206272 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.371s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 10:59:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 10:59:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrXjHWto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:00:02 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:00:02 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:00:02 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fe8dae-9dbf-4883-9760-f32935773774]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:00:02 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ddea48-61b6-487d-ac05-5c9e5107826b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9] added
Oct 30 11:00:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6679ddde-ff88-4805-9e04-cbe2167a6ef0]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee24f91e-4ef6-4ffb-bccc-4fed467b3e98]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrXjHWto {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrXjHWto" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[060a353e-e53e-4805-9fce-f1863cd58bd4]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YrXjHWto'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c711a11-93f0-4a83-a773-4373178cd4d8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8545adc-6885-411a-9ac3-e377e0d096cd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f45a04d-1821-401f-8304-7389e926b34a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9, portal: 172.16.0.220,3260]
Oct 30 11:00:02 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9, portal: 172.16.0.220,3260] successful.
Oct 30 11:00:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[433e8a3e-9b04-4eb1-9419-2ccc8dd46de3]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63ec08d-791e-4ca9-9dfc-b5a245196d9b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)
Oct 30 11:00:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1867cf4a-7116-4710-be26-9a4015a85063]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:00:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrXjHWto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:00:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:00:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23537306464303464', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:00:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537306464303464', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:00:03 user nova-compute[74278]: DEBUG nova.objects.instance [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'flavor' on Instance uuid d6bdec9e-b5dc-483d-b89e-ece814c92e42 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:00:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:00:04 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:00:04 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:00:04 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:00:04 user nova-compute[74278]:   <serial>86d03b4b-6f42-420e-9f0e-5d63ebf31bc9</serial>
Oct 30 11:00:04 user nova-compute[74278]: </disk>
Oct 30 11:00:04 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:00:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:00:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:00:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No VIF found with MAC fa:16:3e:fd:9f:c7, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:00:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-89efa737-772d-4e8b-8bf0-de79726e3e6d tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.716s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:05 user nova-compute[74278]: INFO nova.compute.manager [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Detaching volume 86d03b4b-6f42-420e-9f0e-5d63ebf31bc9
Oct 30 11:00:05 user nova-compute[74278]: INFO nova.virt.block_device [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Attempting to driver detach volume 86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 from mountpoint /dev/vdb
Oct 30 11:00:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Attempting to detach device vdb from instance d6bdec9e-b5dc-483d-b89e-ece814c92e42 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:00:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:00:05 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:00:05 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:00:05 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:00:05 user nova-compute[74278]:   <serial>86d03b4b-6f42-420e-9f0e-5d63ebf31bc9</serial>
Oct 30 11:00:05 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:00:05 user nova-compute[74278]: </disk>
Oct 30 11:00:05 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:00:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully detached device vdb from instance d6bdec9e-b5dc-483d-b89e-ece814c92e42 from the persistent domain config.
Oct 30 11:00:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6bdec9e-b5dc-483d-b89e-ece814c92e42 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:00:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:00:05 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:00:05 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:00:05 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:00:05 user nova-compute[74278]:   <serial>86d03b4b-6f42-420e-9f0e-5d63ebf31bc9</serial>
Oct 30 11:00:05 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:00:05 user nova-compute[74278]: </disk>
Oct 30 11:00:05 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:00:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6bdec9e-b5dc-483d-b89e-ece814c92e42 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:00:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:06 user nova-compute[74278]: INFO nova.compute.manager [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Detaching volume c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1
Oct 30 11:00:06 user nova-compute[74278]: INFO nova.virt.block_device [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Attempting to driver detach volume c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 from mountpoint /dev/vdb
Oct 30 11:00:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Attempting to detach device vdb from instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:00:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:00:06 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:00:06 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:00:06 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:00:06 user nova-compute[74278]:   <serial>c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1</serial>
Oct 30 11:00:06 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 11:00:06 user nova-compute[74278]: </disk>
Oct 30 11:00:06 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:00:06 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully detached device vdb from instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa from the persistent domain config.
Oct 30 11:00:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:00:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:00:06 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:00:06 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:00:06 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:00:06 user nova-compute[74278]:   <serial>c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1</serial>
Oct 30 11:00:06 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 11:00:06 user nova-compute[74278]: </disk>
Oct 30 11:00:06 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:00:07 user nova-compute[74278]: INFO nova.compute.manager [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] [instance: f5fec1d4-833e-44db-8226-795fd62b18d8] Took 23.06 seconds to detach 3 volumes for instance.
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlEDrgZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ed94499-397a-4dc4-94da-13eb67312572', 'attached_at': '', 'detached_at': '', 'volume_id': '6a5f0606-50af-4c7c-82dc-876d226675bd', 'serial': '6a5f0606-50af-4c7c-82dc-876d226675bd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnAfdErK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0'}, 'status': 'reserved', 'instance': '5ed94499-397a-4dc4-94da-13eb67312572', 'attached_at': '', 'detached_at': '', 'volume_id': 'adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0', 'serial'} {{(pid=74278) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlEDrgZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:00:07 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:00:07 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:00:07 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c423bbf6-78fe-4cfd-8fbc-1e4e8bfddf7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:00:07 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b916fb4-c35c-45af-8daf-d5086e055234]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd] added
Oct 30 11:00:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be472b9-d9b8-4bec-aa2c-3ac38e92c969]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ca65b4-3005-4670-a99f-5fe8c4ad85ce]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlEDrgZO {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlEDrgZO" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[053ac6f8-3934-4fa0-a4ef-9e71c2c68b52]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dlEDrgZO'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dafa214-3e98-4b81-91d3-b15d6e0b7323]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:07 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Deleted allocations for instance f5fec1d4-833e-44db-8226-795fd62b18d8
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b432a1-cb9e-4b0c-bafa-605ed875b9cb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[40124d0b-0322-4ed6-be00-d778e453be0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260]
Oct 30 11:00:07 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260] successful.
Oct 30 11:00:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[953e9950-1ba7-4b9c-91e8-4798bfa599e4]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c916adef-97a0-4ba3-aba3-747b3e987489 tempest-TaggedBootDevicesTest_v242-993466353 tempest-TaggedBootDevicesTest_v242-993466353-project-member] Lock "f5fec1d4-833e-44db-8226-795fd62b18d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 34.129s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[faeed145-f812-4751-bdb7-68a5d108958d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)
Oct 30 11:00:07 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9695e57c-4bb2-4b99-bba1-36f51de750ad]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:00:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlEDrgZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:00:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:00:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26337343033313436', 'path': '/dev/sdd'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:00:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337343033313436', 'path': '/dev/sdd'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:00:08 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lazy-loading 'flavor' on Instance uuid 5ed94499-397a-4dc4-94da-13eb67312572 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:00:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 128974848 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:10 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 291504128 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:10 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 434110464 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 565182464 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 730857472 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 879755264 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 986710016 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-dae69219-e5b6-41ec-abec-e040c577d954 req-ae51812e-7ad6-4a01-bd6b-b71f12d6d8e7 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Received event network-changed-a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-dae69219-e5b6-41ec-abec-e040c577d954 req-ae51812e-7ad6-4a01-bd6b-b71f12d6d8e7 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Refreshing instance network info cache due to event network-changed-a7c51798-cdc7-4e93-992e-38005422a757. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-dae69219-e5b6-41ec-abec-e040c577d954 req-ae51812e-7ad6-4a01-bd6b-b71f12d6d8e7 service nova] Acquiring lock "refresh_cache-a6ad2df0-d37c-43f8-bb93-1fb3894b4593" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-dae69219-e5b6-41ec-abec-e040c577d954 req-ae51812e-7ad6-4a01-bd6b-b71f12d6d8e7 service nova] Acquired lock "refresh_cache-a6ad2df0-d37c-43f8-bb93-1fb3894b4593" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG nova.network.neutron [req-dae69219-e5b6-41ec-abec-e040c577d954 req-ae51812e-7ad6-4a01-bd6b-b71f12d6d8e7 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Refreshing network info cache for port a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MnAfdErK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:00:13 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f492e387-7e75-41ae-ae77-87663bfb16fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:00:13 user nova-compute[74278]: No targets found.
Oct 30 11:00:13 user nova-compute[74278]: iSNS:
Oct 30 11:00:13 user nova-compute[74278]: No targets found.
Oct 30 11:00:13 user nova-compute[74278]: STATIC:
Oct 30 11:00:13 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0
Oct 30 11:00:13 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:13 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:13 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd
Oct 30 11:00:13 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:13 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:13 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1
Oct 30 11:00:13 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:13 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:13 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:00:13 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:13 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:13 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9
Oct 30 11:00:13 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:13 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:13 user nova-compute[74278]: FIRMWARE:
Oct 30 11:00:13 user nova-compute[74278]: No targets found.
Oct 30 11:00:13 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:00:13 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:00:13 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5e842f-b044-4e96-b9f6-556a3f05e2f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[998c4f5e-256b-4564-b781-0ba260b076e8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:13 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:13 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 11:00:13 user nova-compute[74278]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)
Oct 30 11:00:13 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:13 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:13 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:13 user nova-compute[74278]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 (non-flash)
Oct 30 11:00:13 user nova-compute[74278]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)
Oct 30 11:00:13 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:13 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c4a75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0'): ({'sdi'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Removing single pathed devices sdi {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4894328-9f33-49ff-ae62-d7209be4f72a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b48ae23-dd63-43d7-ab49-14acec07984a]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Flushing IO for device /dev/sdi {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG nova.network.neutron [req-dae69219-e5b6-41ec-abec-e040c577d954 req-ae51812e-7ad6-4a01-bd6b-b71f12d6d8e7 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Updated VIF entry in instance network info cache for port a7c51798-cdc7-4e93-992e-38005422a757. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG nova.network.neutron [req-dae69219-e5b6-41ec-abec-e040c577d954 req-ae51812e-7ad6-4a01-bd6b-b71f12d6d8e7 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Updating instance_info_cache with network_info: [{"id": "a7c51798-cdc7-4e93-992e-38005422a757", "address": "fa:16:3e:55:71:cd", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c51798-cd", "ovs_interfaceid": "a7c51798-cdc7-4e93-992e-38005422a757", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b27842-f7e3-45ed-934e-cd5e417844f8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-dae69219-e5b6-41ec-abec-e040c577d954 req-ae51812e-7ad6-4a01-bd6b-b71f12d6d8e7 service nova] Releasing lock "refresh_cache-a6ad2df0-d37c-43f8-bb93-1fb3894b4593" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f24046-1c5e-4a23-8a3a-2e7d4c009320]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] SCSI volumes sdi have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f34afc-d09b-4230-bc29-804cf078fbba]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG nova.objects.instance [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lazy-loading 'flavor' on Instance uuid a6ad2df0-d37c-43f8-bb93-1fb3894b4593 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[248b308b-5d74-401c-93a8-4ea910783f75]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0, portal: 172.16.0.220,3260]
Oct 30 11:00:13 user nova-compute[74278]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0, portal: 172.16.0.220,3260] successful.
Oct 30 11:00:13 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[faddf28c-a335-4b5e-823f-3fc2e5dad44a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] <== disconnect_volume: return (337ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlEDrgZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5ed94499-397a-4dc4-94da-13eb67312572', 'attached_at': '', 'detached_at': '', 'volume_id': '6a5f0606-50af-4c7c-82dc-876d226675bd', 'serial'} {{(pid=74278) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] swap_volume: removing Cinder connection for volume adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 {{(pid=74278) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:13 user nova-compute[74278]: INFO nova.compute.manager [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Attaching volume 84273602-c56c-431e-89f0-bc3c3657cb7e to /dev/vdb
Oct 30 11:00:14 user nova-compute[74278]: DEBUG os_brick.utils [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e75c3a-a1d1-47f5-a568-4825ccefa46e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[138e6967-bb18-4541-a4b0-22d9b3b1ae8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[97da5d2b-efe4-470f-b1d1-f62b3edf7937]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[15806d75-2c8c-48e8-9cd6-d085e0e8364e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:00:14 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:00:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c34be2-a43f-49a3-8c46-712948709e44]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG os_brick.utils [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Updating existing volume attachment record: 1c7d1b91-8c42-4fc0-aeac-3d1550638ec8 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:14 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] swap_volume: Updating volume adbfc9d4-e4b3-4926-ac2d-5b7f9cbc43d0 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "dlEDrgZO", "auth_password": "yIV2RPGmS6bn9B", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "6a5f0606-50af-4c7c-82dc-876d226675bd"}, "status": "reserved", "instance": "5ed94499-397a-4dc4-94da-13eb67312572", "attached_at": "", "detached_at": "", "volume_id": "6a5f0606-50af-4c7c-82dc-876d226675bd", "serial": "6a5f0606-50af-4c7c-82dc-876d226675bd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6a5f0606-50af-4c7c-82dc-876d226675bd', 'no_device': None, 'attachment_id': 'e54fdbe3-c04e-4daa-85db-37bea8f96978'} {{(pid=74278) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 30 11:00:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8cb1edd7-b7d6-4619-adf0-84198eccea06 tempest-TestVolumeSwap-558730290 tempest-TestVolumeSwap-558730290-project-admin] Lock "5ed94499-397a-4dc4-94da-13eb67312572" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 37.766s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "5ed94499-397a-4dc4-94da-13eb67312572" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:15 user nova-compute[74278]: INFO nova.compute.manager [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Detaching volume 6a5f0606-50af-4c7c-82dc-876d226675bd
Oct 30 11:00:15 user nova-compute[74278]: INFO nova.virt.block_device [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Attempting to driver detach volume 6a5f0606-50af-4c7c-82dc-876d226675bd from mountpoint /dev/vdb
Oct 30 11:00:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Attempting to detach device vdb from instance 5ed94499-397a-4dc4-94da-13eb67312572 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:00:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:00:15 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:00:15 user nova-compute[74278]:   <source dev="/dev/sdd"/>
Oct 30 11:00:15 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:00:15 user nova-compute[74278]:   <serial>6a5f0606-50af-4c7c-82dc-876d226675bd</serial>
Oct 30 11:00:15 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:00:15 user nova-compute[74278]: </disk>
Oct 30 11:00:15 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:00:15 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Successfully detached device vdb from instance 5ed94499-397a-4dc4-94da-13eb67312572 from the persistent domain config.
Oct 30 11:00:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5ed94499-397a-4dc4-94da-13eb67312572 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:00:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:00:15 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:00:15 user nova-compute[74278]:   <source dev="/dev/sdd"/>
Oct 30 11:00:15 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:00:15 user nova-compute[74278]:   <serial>6a5f0606-50af-4c7c-82dc-876d226675bd</serial>
Oct 30 11:00:15 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:00:15 user nova-compute[74278]: </disk>
Oct 30 11:00:15 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:00:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5ed94499-397a-4dc4-94da-13eb67312572 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:00:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:22 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:00:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:00:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:23 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:00:23 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:00:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:24 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:00:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:25 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:00:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:00:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:00:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:00:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:00:25 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d6bdec9e-b5dc-483d-b89e-ece814c92e42 is timed out.
Oct 30 11:00:25 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully detached device vdb from instance d6bdec9e-b5dc-483d-b89e-ece814c92e42 from the live domain config.
Oct 30 11:00:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:00:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrXjHWto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:00:25 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:00:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:00:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:00:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dea0f55-ef1c-4f54-9cb5-0a9d09a4b396]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:00:26 user nova-compute[74278]: No targets found.
Oct 30 11:00:26 user nova-compute[74278]: iSNS:
Oct 30 11:00:26 user nova-compute[74278]: No targets found.
Oct 30 11:00:26 user nova-compute[74278]: STATIC:
Oct 30 11:00:26 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd
Oct 30 11:00:26 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:26 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:26 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1
Oct 30 11:00:26 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:26 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:26 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:00:26 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:26 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:26 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9
Oct 30 11:00:26 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:26 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:26 user nova-compute[74278]: FIRMWARE:
Oct 30 11:00:26 user nova-compute[74278]: No targets found.
Oct 30 11:00:26 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:00:26 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:00:26 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[453561ee-8592-44d9-a0b3-fd6970809e31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf09b454-2410-49d9-a71e-45780b42186a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:26 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:26 user nova-compute[74278]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)
Oct 30 11:00:26 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:26 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:26 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:26 user nova-compute[74278]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 (non-flash)
Oct 30 11:00:26 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:26 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac26d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdb6a3f-8b74-41b1-aab8-3ff391290e2a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc86ab9-a7f0-455a-94d3-97afbdef8ea5]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d006e70-5e4f-4c1a-a12e-487440087096]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[40297e51-278b-4586-9333-041b3416eec6]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09614ec-e58a-4cc3-9627-98f8a2f14b19]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c41be4b-6fae-48d4-9703-6d823a18d821]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9, portal: 172.16.0.220,3260]
Oct 30 11:00:26 user nova-compute[74278]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9, portal: 172.16.0.220,3260] successful.
Oct 30 11:00:26 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86d03b4b-6f42-420e-9f0e-5d63ebf31bc9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd02810-b1ff-4f8a-b4f1-ca4c01365efb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] <== disconnect_volume: return (348ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Updating instance_info_cache with network_info: [{"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa is timed out.
Oct 30 11:00:27 user nova-compute[74278]: DEBUG nova.objects.instance [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'flavor' on Instance uuid d6bdec9e-b5dc-483d-b89e-ece814c92e42 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:00:27 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully detached device vdb from instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa from the live domain config.
Oct 30 11:00:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'geJNihYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:00:27 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75bdda1-b61c-4470-a58d-17a32f1c2a5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:00:27 user nova-compute[74278]: No targets found.
Oct 30 11:00:27 user nova-compute[74278]: iSNS:
Oct 30 11:00:27 user nova-compute[74278]: No targets found.
Oct 30 11:00:27 user nova-compute[74278]: STATIC:
Oct 30 11:00:27 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd
Oct 30 11:00:27 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:27 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:27 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1
Oct 30 11:00:27 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:27 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:27 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:00:27 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:27 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:27 user nova-compute[74278]: FIRMWARE:
Oct 30 11:00:27 user nova-compute[74278]: No targets found.
Oct 30 11:00:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:00:27 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:00:27 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9ed3a9-6e6d-4c7f-962d-6433ee2cba29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21eb43e-3ec7-4b42-b0a5-0bc53aca6b9b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:27 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:27 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:27 user nova-compute[74278]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 (non-flash)
Oct 30 11:00:27 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c36a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f7b0445e-1acc-44e2-bdc4-cedae55f2252 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.079s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa0674d-c890-4d11-a20c-cb25dd8bc7a8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad62405-f5fb-44d0-839d-7e3015359790]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c761fb82-cacc-4449-85d2-6ed73c3f313e]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c80df7-9de1-463b-ac43-ee3abd799d30]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66ee7a1-9b03-48e6-aab8-d9bceebbe250]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc4b5c7-3a9b-4fc4-a6ad-47fc1ec7c268]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260]
Oct 30 11:00:27 user nova-compute[74278]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1, portal: 172.16.0.220,3260] successful.
Oct 30 11:00:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5f63321-e141-4ea5-b8b3-f6c1a8b7bfa1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbdc830-4e8b-4436-9101-90e21c007289]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] <== disconnect_volume: return (416ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:00:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:31 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:00:31 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7270MB free_disk=24.921875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 5ed94499-397a-4dc4-94da-13eb67312572 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance d6bdec9e-b5dc-483d-b89e-ece814c92e42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a6ad2df0-d37c-43f8-bb93-1fb3894b4593 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 64287717-7d3b-4087-aedf-faf87be774a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2b8efca4-cec4-4179-99af-92172f9b8a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 23852f7e-6e4a-4e19-91ff-d9914c04cf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:00:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.759s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:00:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:00:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPrvwFQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:00:34 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:00:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:00:34 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:00:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:00:34 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[678cafb8-f862-4ef0-84aa-59a757c4ab46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:00:34 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae5c21c-98d5-4bac-9cb5-3d201e3b3b35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e] added
Oct 30 11:00:34 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ffd9c8-7e9f-4cf0-a419-1dd7107f7be3]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb7d886-420e-4cfb-9480-282f7e8b0493]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPrvwFQd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPrvwFQd" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abb0a1e-b040-437d-9545-daf7ca535dcd]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mPrvwFQd'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7746c4-119b-4dc7-8bb6-c8a691d0c7ae]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f1f035-459b-4e05-b8c2-4e92fc050cd8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:35 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:35 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:35 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:35 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f840972-e559-4d9c-a680-552914bc8102]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e, portal: 172.16.0.220,3260]
Oct 30 11:00:35 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e, portal: 172.16.0.220,3260] successful.
Oct 30 11:00:35 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1914bc-e410-4647-b70d-839f0e65a280]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ef4781-8e27-4834-a208-bfc4c10e6899]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:35 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:35 user nova-compute[74278]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e (non-flash)
Oct 30 11:00:35 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:35 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:35 user nova-compute[74278]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e (non-flash)
Oct 30 11:00:35 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc6c6ae-66b9-473e-ad31-7582fa988560]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:35 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:36 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5ed94499-397a-4dc4-94da-13eb67312572 is timed out.
Oct 30 11:00:36 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Successfully detached device vdb from instance 5ed94499-397a-4dc4-94da-13eb67312572 from the live domain config.
Oct 30 11:00:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlEDrgZO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '6a5f0606-50af-4c7c-82dc-876d226675bd'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:00:36 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPrvwFQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26463303061623765', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463303061623765', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.091s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG nova.objects.instance [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lazy-loading 'flavor' on Instance uuid a6ad2df0-d37c-43f8-bb93-1fb3894b4593 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6982e65a-299e-4388-af57-783ecf3da350]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:00:36 user nova-compute[74278]: No targets found.
Oct 30 11:00:36 user nova-compute[74278]: iSNS:
Oct 30 11:00:36 user nova-compute[74278]: No targets found.
Oct 30 11:00:36 user nova-compute[74278]: STATIC:
Oct 30 11:00:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd
Oct 30 11:00:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e
Oct 30 11:00:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:00:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:36 user nova-compute[74278]: FIRMWARE:
Oct 30 11:00:36 user nova-compute[74278]: No targets found.
Oct 30 11:00:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:00:36 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:00:36 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:00:36 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:00:36 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:00:36 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:00:36 user nova-compute[74278]:   <serial>84273602-c56c-431e-89f0-bc3c3657cb7e</serial>
Oct 30 11:00:36 user nova-compute[74278]: </disk>
Oct 30 11:00:36 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bfa2b7-7371-4f63-892c-46409322a068]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1ec03b-d801-435b-afe2-79e7da7dfd30]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:36 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:36 user nova-compute[74278]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e (non-flash)
Oct 30 11:00:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:36 user nova-compute[74278]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd (non-flash)
Oct 30 11:00:36 user nova-compute[74278]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e (non-flash)
Oct 30 11:00:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c36ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd'): ({'sdd'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Removing single pathed devices sdd {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[de97e2ab-25f1-4ef9-9ab9-912386fa4869]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7d449c-668c-45e7-a85d-8883b799c116]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Flushing IO for device /dev/sdd {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[699174cd-d96c-4045-a3d7-56bc442424fa]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f43158b-5e59-4ac9-8cc3-344335aff0d6]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[076c46a5-bd18-4e90-854d-d811e7649544]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1acef0f-a09b-42ad-b2db-eb34751fd368]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260]
Oct 30 11:00:36 user nova-compute[74278]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd, portal: 172.16.0.220,3260] successful.
Oct 30 11:00:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a5f0606-50af-4c7c-82dc-876d226675bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5c76af-2b04-4b7a-9c74-3041c27dfea3]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] <== disconnect_volume: return (451ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] No VIF found with MAC fa:16:3e:55:71:cd, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:00:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-772aa839-140f-425e-8f2c-cf54a5a8bb58 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.954s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:37 user nova-compute[74278]: DEBUG nova.objects.instance [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lazy-loading 'flavor' on Instance uuid 5ed94499-397a-4dc4-94da-13eb67312572 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:00:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5687f224-3d6a-47ca-bffb-fc959e44aabb tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "5ed94499-397a-4dc4-94da-13eb67312572" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.297s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:38 user nova-compute[74278]: INFO nova.compute.manager [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Detaching volume 84273602-c56c-431e-89f0-bc3c3657cb7e
Oct 30 11:00:38 user nova-compute[74278]: INFO nova.virt.block_device [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Attempting to driver detach volume 84273602-c56c-431e-89f0-bc3c3657cb7e from mountpoint /dev/vdb
Oct 30 11:00:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Attempting to detach device vdb from instance a6ad2df0-d37c-43f8-bb93-1fb3894b4593 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:00:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:00:38 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:00:38 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:00:38 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:00:38 user nova-compute[74278]:   <serial>84273602-c56c-431e-89f0-bc3c3657cb7e</serial>
Oct 30 11:00:38 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:00:38 user nova-compute[74278]: </disk>
Oct 30 11:00:38 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:00:38 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Successfully detached device vdb from instance a6ad2df0-d37c-43f8-bb93-1fb3894b4593 from the persistent domain config.
Oct 30 11:00:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6ad2df0-d37c-43f8-bb93-1fb3894b4593 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:00:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:00:38 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:00:38 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:00:38 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:00:38 user nova-compute[74278]:   <serial>84273602-c56c-431e-89f0-bc3c3657cb7e</serial>
Oct 30 11:00:38 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:00:38 user nova-compute[74278]: </disk>
Oct 30 11:00:38 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:00:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6ad2df0-d37c-43f8-bb93-1fb3894b4593 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:00:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:39 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:00:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e436e4e6-baca-4f7b-82b9-e4996d35abef tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.993s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9972a979-3896-479e-8a36-f623a0d7447f tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9972a979-3896-479e-8a36-f623a0d7447f tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9972a979-3896-479e-8a36-f623a0d7447f tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:00:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9972a979-3896-479e-8a36-f623a0d7447f tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74278) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 30 11:00:40 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9972a979-3896-479e-8a36-f623a0d7447f tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:00:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:41 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance destroyed successfully.
Oct 30 11:00:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9972a979-3896-479e-8a36-f623a0d7447f tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:00:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9972a979-3896-479e-8a36-f623a0d7447f tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.930s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-00624849-36ea-44bc-9144-f1a9cc86f4d0 req-56a2c0b4-4a0d-434b-940c-5f7d2c29f467 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-vif-unplugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:00:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-00624849-36ea-44bc-9144-f1a9cc86f4d0 req-56a2c0b4-4a0d-434b-940c-5f7d2c29f467 service nova] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-00624849-36ea-44bc-9144-f1a9cc86f4d0 req-56a2c0b4-4a0d-434b-940c-5f7d2c29f467 service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-00624849-36ea-44bc-9144-f1a9cc86f4d0 req-56a2c0b4-4a0d-434b-940c-5f7d2c29f467 service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-00624849-36ea-44bc-9144-f1a9cc86f4d0 req-56a2c0b4-4a0d-434b-940c-5f7d2c29f467 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] No waiting events found dispatching network-vif-unplugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:00:44 user nova-compute[74278]: WARNING nova.compute.manager [req-00624849-36ea-44bc-9144-f1a9cc86f4d0 req-56a2c0b4-4a0d-434b-940c-5f7d2c29f467 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received unexpected event network-vif-unplugged-c2c68f43-b884-4bf0-8948-447c35ce1402 for instance with vm_state stopped and task_state None.
Oct 30 11:00:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-1f6a1967-5136-4ee1-9c39-d0be37d36f7a req-8353a5bf-b579-46f0-af68-541049bf8a15 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:00:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1f6a1967-5136-4ee1-9c39-d0be37d36f7a req-8353a5bf-b579-46f0-af68-541049bf8a15 service nova] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1f6a1967-5136-4ee1-9c39-d0be37d36f7a req-8353a5bf-b579-46f0-af68-541049bf8a15 service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1f6a1967-5136-4ee1-9c39-d0be37d36f7a req-8353a5bf-b579-46f0-af68-541049bf8a15 service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-1f6a1967-5136-4ee1-9c39-d0be37d36f7a req-8353a5bf-b579-46f0-af68-541049bf8a15 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] No waiting events found dispatching network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:00:46 user nova-compute[74278]: WARNING nova.compute.manager [req-1f6a1967-5136-4ee1-9c39-d0be37d36f7a req-8353a5bf-b579-46f0-af68-541049bf8a15 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received unexpected event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 for instance with vm_state stopped and task_state None.
Oct 30 11:00:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:00:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:47 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:00:47 user nova-compute[74278]: INFO nova.compute.claims [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Claim successful on node user
Oct 30 11:00:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:48 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:00:48 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:00:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:00:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:00:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:00:48 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:00:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:00:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:00:48 user nova-compute[74278]: INFO nova.compute.manager [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] instance snapshotting
Oct 30 11:00:48 user nova-compute[74278]: DEBUG nova.policy [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '584de218cec24240a91845deca515efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd01e2d9be4a0b96e94493f8eb43d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:00:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Beginning live snapshot process
Oct 30 11:00:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:00:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:00:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Creating image(s)
Oct 30 11:00:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "/opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "/opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json -f qcow2 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.207s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json -f qcow2 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk 1073741824" returned: 0 in 0.059s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Successfully created port: 0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json -f qcow2" returned: 0 in 0.303s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.225s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.194s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzbrohcje/99705abf2ae54718a152048ceeba2ac2.delta 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Cannot resize image /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Ensure instance console log exists: /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzbrohcje/99705abf2ae54718a152048ceeba2ac2.delta 1073741824" returned: 0 in 0.072s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:49 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Successfully updated port: 0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquired lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-54e30d74-a299-4135-ae92-4d49bfda4ecd req-0f662415-733a-4d84-8fb7-a079952e264b service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-changed-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-54e30d74-a299-4135-ae92-4d49bfda4ecd req-0f662415-733a-4d84-8fb7-a079952e264b service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Refreshing instance network info cache due to event network-changed-0ca50716-192b-473f-bc5a-d1136a8d52dd. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-54e30d74-a299-4135-ae92-4d49bfda4ecd req-0f662415-733a-4d84-8fb7-a079952e264b service nova] Acquiring lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-3bfd3670-0bf0-4f67-b3d4-4f91c0373259 req-55760a38-d54d-44d2-8dac-61b13cd8a1da service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Received event network-changed-f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.compute.manager [req-3bfd3670-0bf0-4f67-b3d4-4f91c0373259 req-55760a38-d54d-44d2-8dac-61b13cd8a1da service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Refreshing instance network info cache due to event network-changed-f802cc84-3654-430b-8c5f-c862a7bababc. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3bfd3670-0bf0-4f67-b3d4-4f91c0373259 req-55760a38-d54d-44d2-8dac-61b13cd8a1da service nova] Acquiring lock "refresh_cache-2b8efca4-cec4-4179-99af-92172f9b8a06" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3bfd3670-0bf0-4f67-b3d4-4f91c0373259 req-55760a38-d54d-44d2-8dac-61b13cd8a1da service nova] Acquired lock "refresh_cache-2b8efca4-cec4-4179-99af-92172f9b8a06" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.network.neutron [req-3bfd3670-0bf0-4f67-b3d4-4f91c0373259 req-55760a38-d54d-44d2-8dac-61b13cd8a1da service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Refreshing network info cache for port f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updating instance_info_cache with network_info: [{"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Releasing lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Instance network_info: |[{"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-54e30d74-a299-4135-ae92-4d49bfda4ecd req-0f662415-733a-4d84-8fb7-a079952e264b service nova] Acquired lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.network.neutron [req-54e30d74-a299-4135-ae92-4d49bfda4ecd req-0f662415-733a-4d84-8fb7-a079952e264b service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Refreshing network info cache for port 0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Start _get_guest_xml network_info=[{"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:00:50 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:00:50 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1355088922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1355088922',id=25,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfQ76Zf86y/rjX/IZezKroDYRlFxXL4tU5bjyfpE8hTO7Xt3y63g6U10DcW7GCutVK3ORDNhBNel2yoFanFAo9wPHbUl8cHjyHqp+8+3mQyx7QRSBig2itKO+0OYjDbew==',key_name='tempest-keypair-344221549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31dd01e2d9be4a0b96e94493f8eb43d7',ramdisk_id='',reservation_id='r-y1dpjo0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2142703659',owner_user_name='tempest-AttachVolumeShelveTestJSON-2142703659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584de218cec24240a91845deca515efa',uuid=5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converting VIF {"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.objects.instance [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:00:50 user nova-compute[74278]:   <uuid>5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3</uuid>
Oct 30 11:00:50 user nova-compute[74278]:   <name>instance-00000019</name>
Oct 30 11:00:50 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:00:50 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:00:50 user nova-compute[74278]:   <metadata>
Oct 30 11:00:50 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:00:50 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:00:50 user nova-compute[74278]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1355088922</nova:name>
Oct 30 11:00:50 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:00:50</nova:creationTime>
Oct 30 11:00:50 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:00:50 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:00:50 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:00:50 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:00:50 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:00:50 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:00:50 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:00:50 user nova-compute[74278]:       <nova:owner>
Oct 30 11:00:50 user nova-compute[74278]:         <nova:user uuid="584de218cec24240a91845deca515efa">tempest-AttachVolumeShelveTestJSON-2142703659-project-member</nova:user>
Oct 30 11:00:50 user nova-compute[74278]:         <nova:project uuid="31dd01e2d9be4a0b96e94493f8eb43d7">tempest-AttachVolumeShelveTestJSON-2142703659</nova:project>
Oct 30 11:00:50 user nova-compute[74278]:       </nova:owner>
Oct 30 11:00:50 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:00:50 user nova-compute[74278]:       <nova:ports>
Oct 30 11:00:50 user nova-compute[74278]:         <nova:port uuid="0ca50716-192b-473f-bc5a-d1136a8d52dd">
Oct 30 11:00:50 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 11:00:50 user nova-compute[74278]:         </nova:port>
Oct 30 11:00:50 user nova-compute[74278]:       </nova:ports>
Oct 30 11:00:50 user nova-compute[74278]:     </nova:instance>
Oct 30 11:00:50 user nova-compute[74278]:   </metadata>
Oct 30 11:00:50 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:00:50 user nova-compute[74278]:     <system>
Oct 30 11:00:50 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:00:50 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:00:50 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:00:50 user nova-compute[74278]:       <entry name="serial">5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3</entry>
Oct 30 11:00:50 user nova-compute[74278]:       <entry name="uuid">5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3</entry>
Oct 30 11:00:50 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:00:50 user nova-compute[74278]:     </system>
Oct 30 11:00:50 user nova-compute[74278]:   </sysinfo>
Oct 30 11:00:50 user nova-compute[74278]:   <os>
Oct 30 11:00:50 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:00:50 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:00:50 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:00:50 user nova-compute[74278]:   </os>
Oct 30 11:00:50 user nova-compute[74278]:   <features>
Oct 30 11:00:50 user nova-compute[74278]:     <acpi/>
Oct 30 11:00:50 user nova-compute[74278]:     <apic/>
Oct 30 11:00:50 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:00:50 user nova-compute[74278]:   </features>
Oct 30 11:00:50 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:00:50 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:00:50 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:00:50 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:00:50 user nova-compute[74278]:   </clock>
Oct 30 11:00:50 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:00:50 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:00:50 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:00:50 user nova-compute[74278]:   </cpu>
Oct 30 11:00:50 user nova-compute[74278]:   <devices>
Oct 30 11:00:50 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:00:50 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:00:50 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk"/>
Oct 30 11:00:50 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:00:50 user nova-compute[74278]:     </disk>
Oct 30 11:00:50 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:00:50 user nova-compute[74278]:       <mac address="fa:16:3e:12:c3:5f"/>
Oct 30 11:00:50 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:00:50 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:00:50 user nova-compute[74278]:       <target dev="tap0ca50716-19"/>
Oct 30 11:00:50 user nova-compute[74278]:     </interface>
Oct 30 11:00:50 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:00:50 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/console.log" append="off"/>
Oct 30 11:00:50 user nova-compute[74278]:     </serial>
Oct 30 11:00:50 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:00:50 user nova-compute[74278]:     <video>
Oct 30 11:00:50 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:00:50 user nova-compute[74278]:     </video>
Oct 30 11:00:50 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:00:50 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:00:50 user nova-compute[74278]:     </rng>
Oct 30 11:00:50 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:00:50 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:00:50 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:00:50 user nova-compute[74278]:     </memballoon>
Oct 30 11:00:50 user nova-compute[74278]:   </devices>
Oct 30 11:00:50 user nova-compute[74278]: </domain>
Oct 30 11:00:50 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1355088922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1355088922',id=25,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfQ76Zf86y/rjX/IZezKroDYRlFxXL4tU5bjyfpE8hTO7Xt3y63g6U10DcW7GCutVK3ORDNhBNel2yoFanFAo9wPHbUl8cHjyHqp+8+3mQyx7QRSBig2itKO+0OYjDbew==',key_name='tempest-keypair-344221549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31dd01e2d9be4a0b96e94493f8eb43d7',ramdisk_id='',reservation_id='r-y1dpjo0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2142703659',owner_user_name='tempest-AttachVolumeShelveTestJSON-2142703659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:00:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584de218cec24240a91845deca515efa',uuid=5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converting VIF {"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG os_vif [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c1bec99-bcbf-549e-9cf3-8d30f7191345', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ca50716-19, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ca50716-19, col_values=(('qos', UUID('4b2c14dc-2be1-48da-b576-861ec5b5db37')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ca50716-19, col_values=(('external_ids', {'iface-id': '0ca50716-192b-473f-bc5a-d1136a8d52dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:c3:5f', 'vm-uuid': '5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:00:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:50 user nova-compute[74278]: INFO os_vif [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19')
Oct 30 11:00:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:00:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] No VIF found with MAC fa:16:3e:12:c3:5f, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:00:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:51 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 11:00:51 user nova-compute[74278]: DEBUG nova.network.neutron [req-3bfd3670-0bf0-4f67-b3d4-4f91c0373259 req-55760a38-d54d-44d2-8dac-61b13cd8a1da service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Updated VIF entry in instance network info cache for port f802cc84-3654-430b-8c5f-c862a7bababc. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:00:51 user nova-compute[74278]: DEBUG nova.network.neutron [req-3bfd3670-0bf0-4f67-b3d4-4f91c0373259 req-55760a38-d54d-44d2-8dac-61b13cd8a1da service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Updating instance_info_cache with network_info: [{"id": "f802cc84-3654-430b-8c5f-c862a7bababc", "address": "fa:16:3e:f4:6a:52", "network": {"id": "29f5a489-9312-45e1-9c8b-4d2ce9926744", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-775167779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111e751160ba47198f17085be7a3214d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf802cc84-36", "ovs_interfaceid": "f802cc84-3654-430b-8c5f-c862a7bababc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:00:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3bfd3670-0bf0-4f67-b3d4-4f91c0373259 req-55760a38-d54d-44d2-8dac-61b13cd8a1da service nova] Releasing lock "refresh_cache-2b8efca4-cec4-4179-99af-92172f9b8a06" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:00:51 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 11:00:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzbrohcje/99705abf2ae54718a152048ceeba2ac2.delta /opt/stack/data/nova/instances/snapshots/tmpzbrohcje/99705abf2ae54718a152048ceeba2ac2 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:51 user nova-compute[74278]: DEBUG nova.network.neutron [req-54e30d74-a299-4135-ae92-4d49bfda4ecd req-0f662415-733a-4d84-8fb7-a079952e264b service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updated VIF entry in instance network info cache for port 0ca50716-192b-473f-bc5a-d1136a8d52dd. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:00:51 user nova-compute[74278]: DEBUG nova.network.neutron [req-54e30d74-a299-4135-ae92-4d49bfda4ecd req-0f662415-733a-4d84-8fb7-a079952e264b service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updating instance_info_cache with network_info: [{"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:00:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-54e30d74-a299-4135-ae92-4d49bfda4ecd req-0f662415-733a-4d84-8fb7-a079952e264b service nova] Releasing lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:00:52 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:00:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzbrohcje/99705abf2ae54718a152048ceeba2ac2.delta /opt/stack/data/nova/instances/snapshots/tmpzbrohcje/99705abf2ae54718a152048ceeba2ac2" returned: 0 in 0.649s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:52 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Snapshot extracted, beginning image upload
Oct 30 11:00:52 user nova-compute[74278]: INFO nova.compute.manager [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] instance snapshotting
Oct 30 11:00:52 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Beginning live snapshot process
Oct 30 11:00:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json -f qcow2 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:52 user nova-compute[74278]: DEBUG nova.compute.manager [req-fedbf395-3c65-47ab-91de-022564bf90df req-f1e1b5b5-6ca4-4633-acb8-eb41b28d60fb service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:00:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fedbf395-3c65-47ab-91de-022564bf90df req-f1e1b5b5-6ca4-4633-acb8-eb41b28d60fb service nova] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fedbf395-3c65-47ab-91de-022564bf90df req-f1e1b5b5-6ca4-4633-acb8-eb41b28d60fb service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fedbf395-3c65-47ab-91de-022564bf90df req-f1e1b5b5-6ca4-4633-acb8-eb41b28d60fb service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:52 user nova-compute[74278]: DEBUG nova.compute.manager [req-fedbf395-3c65-47ab-91de-022564bf90df req-f1e1b5b5-6ca4-4633-acb8-eb41b28d60fb service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] No waiting events found dispatching network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:00:52 user nova-compute[74278]: WARNING nova.compute.manager [req-fedbf395-3c65-47ab-91de-022564bf90df req-f1e1b5b5-6ca4-4633-acb8-eb41b28d60fb service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received unexpected event network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd for instance with vm_state building and task_state spawning.
Oct 30 11:00:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json -f qcow2" returned: 0 in 0.224s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json -f qcow2 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json -f qcow2" returned: 0 in 0.279s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7332q9mo/4b45b2de74164767812d2662405c47dc.delta 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7332q9mo/4b45b2de74164767812d2662405c47dc.delta 1073741824" returned: 0 in 0.060s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:53 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 30 11:00:54 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:54 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74278) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 11:00:54 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 11:00:54 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Snapshot image upload complete
Oct 30 11:00:54 user nova-compute[74278]: INFO nova.compute.manager [None req-983c4e11-03ad-436a-9beb-a2ce013c3cea tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Took 6.24 seconds to snapshot the instance on the hypervisor.
Oct 30 11:00:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-d93e118a-9c1b-4aa3-ab02-e37d6bc6304c req-78775246-925b-4208-a672-16ed40b75a72 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:00:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d93e118a-9c1b-4aa3-ab02-e37d6bc6304c req-78775246-925b-4208-a672-16ed40b75a72 service nova] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d93e118a-9c1b-4aa3-ab02-e37d6bc6304c req-78775246-925b-4208-a672-16ed40b75a72 service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d93e118a-9c1b-4aa3-ab02-e37d6bc6304c req-78775246-925b-4208-a672-16ed40b75a72 service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-d93e118a-9c1b-4aa3-ab02-e37d6bc6304c req-78775246-925b-4208-a672-16ed40b75a72 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] No waiting events found dispatching network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:00:55 user nova-compute[74278]: WARNING nova.compute.manager [req-d93e118a-9c1b-4aa3-ab02-e37d6bc6304c req-78775246-925b-4208-a672-16ed40b75a72 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received unexpected event network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd for instance with vm_state building and task_state spawning.
Oct 30 11:00:55 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 11:00:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7332q9mo/4b45b2de74164767812d2662405c47dc.delta /opt/stack/data/nova/instances/snapshots/tmp7332q9mo/4b45b2de74164767812d2662405c47dc {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:55 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:00:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:00:55 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Instance spawned successfully.
Oct 30 11:00:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:00:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:00:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:00:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:00:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:00:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:00:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:00:55 user nova-compute[74278]: INFO nova.compute.manager [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Took 6.42 seconds to spawn the instance on the hypervisor.
Oct 30 11:00:55 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:00:55 user nova-compute[74278]: INFO nova.compute.manager [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Took 7.48 seconds to build instance.
Oct 30 11:00:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4c7d4b6d-b3cc-4a03-9591-751827d165f1 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.663s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7332q9mo/4b45b2de74164767812d2662405c47dc.delta /opt/stack/data/nova/instances/snapshots/tmp7332q9mo/4b45b2de74164767812d2662405c47dc" returned: 0 in 0.523s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:55 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Snapshot extracted, beginning image upload
Oct 30 11:00:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:56 user nova-compute[74278]: INFO nova.compute.manager [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Terminating instance
Oct 30 11:00:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-15a4ca10-092d-498a-85ff-2913e99c0d9f req-3aed5b12-3887-4504-b848-d4d878bfff54 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Received event network-vif-unplugged-f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-15a4ca10-092d-498a-85ff-2913e99c0d9f req-3aed5b12-3887-4504-b848-d4d878bfff54 service nova] Acquiring lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-15a4ca10-092d-498a-85ff-2913e99c0d9f req-3aed5b12-3887-4504-b848-d4d878bfff54 service nova] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-15a4ca10-092d-498a-85ff-2913e99c0d9f req-3aed5b12-3887-4504-b848-d4d878bfff54 service nova] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-15a4ca10-092d-498a-85ff-2913e99c0d9f req-3aed5b12-3887-4504-b848-d4d878bfff54 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] No waiting events found dispatching network-vif-unplugged-f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-15a4ca10-092d-498a-85ff-2913e99c0d9f req-3aed5b12-3887-4504-b848-d4d878bfff54 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Received event network-vif-unplugged-f98897ed-9d97-41d1-8bd0-257b57595656 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:00:56 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Instance destroyed successfully.
Oct 30 11:00:56 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'resources' on Instance uuid d6bdec9e-b5dc-483d-b89e-ece814c92e42 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:57:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1928451537',display_name='tempest-AttachVolumeNegativeTest-server-1928451537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1928451537',id=20,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhoClxba5SCRA1AmJJIPxhIU7zPrOriyWA3wGV4hIA2SZIBnu84WPcOQf4W0uPLo+veRP/M3X2e02WEJtnpxQ3dpfvJoI/nUjXSx7T3uChqJmhBdzHR1x2IVRD9n9uWlw==',key_name='tempest-keypair-1742881020',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:57:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b43bf73deda348f08290daf640768705',ramdisk_id='',reservation_id='r-i8vl8zol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-871157650',owner_user_name='tempest-AttachVolumeNegativeTest-871157650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31e7e6847ec0415fba0fd909c014e802',uuid=d6bdec9e-b5dc-483d-b89e-ece814c92e42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f98897ed-9d97-41d1-8bd0-257b57595656", "address": "fa:16:3e:fd:9f:c7", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98897ed-9d", "ovs_interfaceid": "f98897ed-9d97-41d1-8bd0-257b57595656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converting VIF {"id": "f98897ed-9d97-41d1-8bd0-257b57595656", "address": "fa:16:3e:fd:9f:c7", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98897ed-9d", "ovs_interfaceid": "f98897ed-9d97-41d1-8bd0-257b57595656", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=f98897ed-9d97-41d1-8bd0-257b57595656,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98897ed-9d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG os_vif [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=f98897ed-9d97-41d1-8bd0-257b57595656,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98897ed-9d') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf98897ed-9d, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58db8ef6-08e0-4822-9120-69a27cf2b8e3) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:00:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:57 user nova-compute[74278]: INFO os_vif [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:9f:c7,bridge_name='br-int',has_traffic_filtering=True,id=f98897ed-9d97-41d1-8bd0-257b57595656,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98897ed-9d')
Oct 30 11:00:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Deleting instance files /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42_del
Oct 30 11:00:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Deletion of /opt/stack/data/nova/instances/d6bdec9e-b5dc-483d-b89e-ece814c92e42_del complete
Oct 30 11:00:57 user nova-compute[74278]: INFO nova.compute.manager [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Took 1.08 seconds to destroy the instance on the hypervisor.
Oct 30 11:00:57 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:00:57 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:00:57 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:00:58 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:00:58 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Took 1.00 seconds to deallocate network for instance.
Oct 30 11:00:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-d04d4dbd-f702-428e-a982-3e6fb8b3a1ff req-e0dd0034-aead-4fa6-afef-3997a60bdc22 service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Received event network-vif-deleted-f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:00:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-547bdae1-0914-40fc-8d14-62b6d797f4fb req-1a89d9bd-bfe4-46cf-8245-1710d95b24bf service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Received event network-vif-plugged-f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:00:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-547bdae1-0914-40fc-8d14-62b6d797f4fb req-1a89d9bd-bfe4-46cf-8245-1710d95b24bf service nova] Acquiring lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:00:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-547bdae1-0914-40fc-8d14-62b6d797f4fb req-1a89d9bd-bfe4-46cf-8245-1710d95b24bf service nova] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:00:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-547bdae1-0914-40fc-8d14-62b6d797f4fb req-1a89d9bd-bfe4-46cf-8245-1710d95b24bf service nova] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-547bdae1-0914-40fc-8d14-62b6d797f4fb req-1a89d9bd-bfe4-46cf-8245-1710d95b24bf service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] No waiting events found dispatching network-vif-plugged-f98897ed-9d97-41d1-8bd0-257b57595656 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:00:58 user nova-compute[74278]: WARNING nova.compute.manager [req-547bdae1-0914-40fc-8d14-62b6d797f4fb req-1a89d9bd-bfe4-46cf-8245-1710d95b24bf service nova] [instance: d6bdec9e-b5dc-483d-b89e-ece814c92e42] Received unexpected event network-vif-plugged-f98897ed-9d97-41d1-8bd0-257b57595656 for instance with vm_state deleted and task_state None.
Oct 30 11:00:58 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:00:58 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:00:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.494s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:58 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Deleted allocations for instance d6bdec9e-b5dc-483d-b89e-ece814c92e42
Oct 30 11:00:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e034345a-214b-437b-b935-8e8b50dac704 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "d6bdec9e-b5dc-483d-b89e-ece814c92e42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.806s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:00:58 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Snapshot image upload complete
Oct 30 11:00:58 user nova-compute[74278]: INFO nova.compute.manager [None req-1a7877e3-124c-4ced-a9eb-bbf57c22fddb tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Took 6.75 seconds to snapshot the instance on the hypervisor.
Oct 30 11:00:59 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6ad2df0-d37c-43f8-bb93-1fb3894b4593 is timed out.
Oct 30 11:00:59 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Successfully detached device vdb from instance a6ad2df0-d37c-43f8-bb93-1fb3894b4593 from the live domain config.
Oct 30 11:00:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPrvwFQd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:00:59 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9940647a-335a-4db3-9fe7-f25c7bb3e2f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:00:59 user nova-compute[74278]: No targets found.
Oct 30 11:00:59 user nova-compute[74278]: iSNS:
Oct 30 11:00:59 user nova-compute[74278]: No targets found.
Oct 30 11:00:59 user nova-compute[74278]: STATIC:
Oct 30 11:00:59 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e
Oct 30 11:00:59 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:59 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:59 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:00:59 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:00:59 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:00:59 user nova-compute[74278]: FIRMWARE:
Oct 30 11:00:59 user nova-compute[74278]: No targets found.
Oct 30 11:00:59 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:00:59 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:00:59 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[649e9e8c-0328-4fa2-b047-38ae8cac434e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[835d7be2-9f1d-45dc-b882-bca496b145e5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:59 user nova-compute[74278]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e (non-flash)
Oct 30 11:00:59 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:00:59 user nova-compute[74278]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e (non-flash)
Oct 30 11:00:59 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac5b8d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc11ae5-890d-4e28-83db-2a1252a33b84]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[948808b0-ede6-4cca-bd66-e010779319a8]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e02ddb1-528f-457a-9822-40106f4e179c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.122s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[837c2dce-5217-47ef-b467-a8b8f1869144]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[80359d6b-9d35-479b-87b1-85c45a1acb90]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0797400-b815-4dde-8f92-885ec4ee1686]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e, portal: 172.16.0.220,3260]
Oct 30 11:00:59 user nova-compute[74278]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e, portal: 172.16.0.220,3260] successful.
Oct 30 11:00:59 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84273602-c56c-431e-89f0-bc3c3657cb7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3913ef-f0e9-4ef2-a7df-4d18ca83821f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.463s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] <== disconnect_volume: return (466ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:00:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:01:00 user nova-compute[74278]: DEBUG nova.objects.instance [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lazy-loading 'flavor' on Instance uuid a6ad2df0-d37c-43f8-bb93-1fb3894b4593 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:01:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e4fd544-2e45-4cf7-b993-610fe2a3f690 tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.152s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:05 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:01:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:05 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:01:05 user nova-compute[74278]: INFO nova.compute.claims [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Claim successful on node user
Oct 30 11:01:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "5ed94499-397a-4dc4-94da-13eb67312572" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "5ed94499-397a-4dc4-94da-13eb67312572-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "5ed94499-397a-4dc4-94da-13eb67312572-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:06 user nova-compute[74278]: INFO nova.compute.manager [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Terminating instance
Oct 30 11:01:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.792s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-b7d6d986-1a7a-4600-afeb-2dacbf5f9bc3 req-3b1b5c55-ed9b-41ae-b081-38644b0d826f service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Received event network-vif-unplugged-ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b7d6d986-1a7a-4600-afeb-2dacbf5f9bc3 req-3b1b5c55-ed9b-41ae-b081-38644b0d826f service nova] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b7d6d986-1a7a-4600-afeb-2dacbf5f9bc3 req-3b1b5c55-ed9b-41ae-b081-38644b0d826f service nova] Lock "5ed94499-397a-4dc4-94da-13eb67312572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b7d6d986-1a7a-4600-afeb-2dacbf5f9bc3 req-3b1b5c55-ed9b-41ae-b081-38644b0d826f service nova] Lock "5ed94499-397a-4dc4-94da-13eb67312572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-b7d6d986-1a7a-4600-afeb-2dacbf5f9bc3 req-3b1b5c55-ed9b-41ae-b081-38644b0d826f service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] No waiting events found dispatching network-vif-unplugged-ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-b7d6d986-1a7a-4600-afeb-2dacbf5f9bc3 req-3b1b5c55-ed9b-41ae-b081-38644b0d826f service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Received event network-vif-unplugged-ef16226b-834e-4b0a-943c-52883de41281 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:01:06 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:01:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:01:06 user nova-compute[74278]: INFO nova.virt.block_device [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Booting with volume c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce at /dev/vda
Oct 30 11:01:06 user nova-compute[74278]: DEBUG os_brick.utils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG nova.policy [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e7bb5f85c254f3d9febe9dc037a8459', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e2c85eda9534f06bd5d7db1300d1f73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:01:06 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Instance destroyed successfully.
Oct 30 11:01:06 user nova-compute[74278]: DEBUG nova.objects.instance [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lazy-loading 'resources' on Instance uuid 5ed94499-397a-4dc4-94da-13eb67312572 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:06 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[684ad4dd-cb45-42ce-99ec-32fb6d83e5eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:56:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1536753473',display_name='tempest-TestVolumeSwap-server-1536753473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1536753473',id=17,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+dePl6Ki4ZbKbxlHbk3A0QwrN0pxGBfQoZMksM0hCq6dTV7CGNKGX/SSy2+zPmzFQDp8bGih2K2zmMFxuMlN5hwfsFGHeMRTXRB3UGR2x03LtIauQLKdOf6WXuyVD3qA==',key_name='tempest-keypair-1714170783',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:56:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='396392292c2446ceaec276ff74a110b7',ramdisk_id='',reservation_id='r-0nro4n3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1555628441',owner_user_name='tempest-TestVolumeSwap-1555628441-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40af50ade2ae4f15821cb93bc8bb8fb6',uuid=5ed94499-397a-4dc4-94da-13eb67312572,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef16226b-834e-4b0a-943c-52883de41281", "address": "fa:16:3e:c1:06:31", "network": {"id": "810116c1-412d-4c6d-b69a-a2f8855639bc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1852542095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396392292c2446ceaec276ff74a110b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef16226b-83", "ovs_interfaceid": "ef16226b-834e-4b0a-943c-52883de41281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Converting VIF {"id": "ef16226b-834e-4b0a-943c-52883de41281", "address": "fa:16:3e:c1:06:31", "network": {"id": "810116c1-412d-4c6d-b69a-a2f8855639bc", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1852542095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "396392292c2446ceaec276ff74a110b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef16226b-83", "ovs_interfaceid": "ef16226b-834e-4b0a-943c-52883de41281", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:06:31,bridge_name='br-int',has_traffic_filtering=True,id=ef16226b-834e-4b0a-943c-52883de41281,network=Network(810116c1-412d-4c6d-b69a-a2f8855639bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef16226b-83') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG os_vif [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:06:31,bridge_name='br-int',has_traffic_filtering=True,id=ef16226b-834e-4b0a-943c-52883de41281,network=Network(810116c1-412d-4c6d-b69a-a2f8855639bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef16226b-83') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef16226b-83, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b4ad85-1341-4e3c-b3da-399edab17a21]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1500c700-d39e-4bd9-b93c-6ee49b88e6e2) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:07 user nova-compute[74278]: INFO os_vif [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:06:31,bridge_name='br-int',has_traffic_filtering=True,id=ef16226b-834e-4b0a-943c-52883de41281,network=Network(810116c1-412d-4c6d-b69a-a2f8855639bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef16226b-83')
Oct 30 11:01:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Deleting instance files /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572_del
Oct 30 11:01:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Deletion of /opt/stack/data/nova/instances/5ed94499-397a-4dc4-94da-13eb67312572_del complete
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[178495be-c4a6-4413-b890-4898a397d509]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd7f46c-982b-4b74-9d60-7c1f6ceba9a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:01:07 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[14505038-276a-4083-a61b-42928d7d0107]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG os_brick.utils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Updating existing volume attachment record: 3ea53b23-ed99-46d7-82ab-c63ac28d64ea {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:01:07 user nova-compute[74278]: INFO nova.compute.manager [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 30 11:01:07 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:01:07 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:01:08 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Successfully created port: 8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:01:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c0dcf136-3aad-437e-8afe-52394f68d206 req-be4f70dd-819d-415a-8ffa-d42d6837cc44 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Received event network-vif-plugged-ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c0dcf136-3aad-437e-8afe-52394f68d206 req-be4f70dd-819d-415a-8ffa-d42d6837cc44 service nova] Acquiring lock "5ed94499-397a-4dc4-94da-13eb67312572-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c0dcf136-3aad-437e-8afe-52394f68d206 req-be4f70dd-819d-415a-8ffa-d42d6837cc44 service nova] Lock "5ed94499-397a-4dc4-94da-13eb67312572-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c0dcf136-3aad-437e-8afe-52394f68d206 req-be4f70dd-819d-415a-8ffa-d42d6837cc44 service nova] Lock "5ed94499-397a-4dc4-94da-13eb67312572-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c0dcf136-3aad-437e-8afe-52394f68d206 req-be4f70dd-819d-415a-8ffa-d42d6837cc44 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] No waiting events found dispatching network-vif-plugged-ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:01:08 user nova-compute[74278]: WARNING nova.compute.manager [req-c0dcf136-3aad-437e-8afe-52394f68d206 req-be4f70dd-819d-415a-8ffa-d42d6837cc44 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Received unexpected event network-vif-plugged-ef16226b-834e-4b0a-943c-52883de41281 for instance with vm_state active and task_state deleting.
Oct 30 11:01:09 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:01:09 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Took 1.87 seconds to deallocate network for instance.
Oct 30 11:01:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-9ca98ebc-65a5-4ba8-be32-4a3a7bb5d1d9 req-3b0abf8c-b311-47b3-b35d-709a24149851 service nova] [instance: 5ed94499-397a-4dc4-94da-13eb67312572] Received event network-vif-deleted-ef16226b-834e-4b0a-943c-52883de41281 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Successfully updated port: 8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "refresh_cache-3d76b06b-9009-4879-83f4-819b1d20ce6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquired lock "refresh_cache-3d76b06b-9009-4879-83f4-819b1d20ce6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-5fe16d5a-39a4-4353-9777-5219990852fb req-bdd04ffa-7334-4d22-ac4d-b4a434735ba4 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event network-changed-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-5fe16d5a-39a4-4353-9777-5219990852fb req-bdd04ffa-7334-4d22-ac4d-b4a434735ba4 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Refreshing instance network info cache due to event network-changed-8fac0256-08e9-4391-9b63-41b420e15539. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5fe16d5a-39a4-4353-9777-5219990852fb req-bdd04ffa-7334-4d22-ac4d-b4a434735ba4 service nova] Acquiring lock "refresh_cache-3d76b06b-9009-4879-83f4-819b1d20ce6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Updating instance_info_cache with network_info: [{"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Releasing lock "refresh_cache-3d76b06b-9009-4879-83f4-819b1d20ce6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Instance network_info: |[{"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5fe16d5a-39a4-4353-9777-5219990852fb req-bdd04ffa-7334-4d22-ac4d-b4a434735ba4 service nova] Acquired lock "refresh_cache-3d76b06b-9009-4879-83f4-819b1d20ce6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG nova.network.neutron [req-5fe16d5a-39a4-4353-9777-5219990852fb req-bdd04ffa-7334-4d22-ac4d-b4a434735ba4 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Refreshing network info cache for port 8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:01:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.702s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:09 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Deleted allocations for instance 5ed94499-397a-4dc4-94da-13eb67312572
Oct 30 11:01:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ebe97c04-eb29-4840-a6c3-1d2609b73a7d tempest-TestVolumeSwap-1555628441 tempest-TestVolumeSwap-1555628441-project-member] Lock "5ed94499-397a-4dc4-94da-13eb67312572" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.884s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:10 user nova-compute[74278]: DEBUG nova.network.neutron [req-5fe16d5a-39a4-4353-9777-5219990852fb req-bdd04ffa-7334-4d22-ac4d-b4a434735ba4 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Updated VIF entry in instance network info cache for port 8fac0256-08e9-4391-9b63-41b420e15539. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:01:10 user nova-compute[74278]: DEBUG nova.network.neutron [req-5fe16d5a-39a4-4353-9777-5219990852fb req-bdd04ffa-7334-4d22-ac4d-b4a434735ba4 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Updating instance_info_cache with network_info: [{"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:01:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5fe16d5a-39a4-4353-9777-5219990852fb req-bdd04ffa-7334-4d22-ac4d-b4a434735ba4 service nova] Releasing lock "refresh_cache-3d76b06b-9009-4879-83f4-819b1d20ce6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:01:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:01:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:11 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:01:11 user nova-compute[74278]: INFO nova.compute.claims [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Claim successful on node user
Oct 30 11:01:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:01:12 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:01:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG nova.policy [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b9a38bd9c4e4717b9499ed404ed2d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8215346d10443799d5d450114b09386', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:01:12 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Creating image(s)
Oct 30 11:01:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "/opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "/opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "/opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.198s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.211s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk 1073741824" returned: 0 in 0.055s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.205s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Successfully created port: d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Cannot resize image /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Ensure instance console log exists: /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Successfully updated port: d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "refresh_cache-e94c4f7c-6e99-4694-84d6-ed62c385a4f9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquired lock "refresh_cache-e94c4f7c-6e99-4694-84d6-ed62c385a4f9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-657ffa2f-a822-422c-ab0d-c3f95ea15330 req-b14fa7d7-bdba-43bd-85e3-8f4554239b87 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-changed-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-657ffa2f-a822-422c-ab0d-c3f95ea15330 req-b14fa7d7-bdba-43bd-85e3-8f4554239b87 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Refreshing instance network info cache due to event network-changed-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-657ffa2f-a822-422c-ab0d-c3f95ea15330 req-b14fa7d7-bdba-43bd-85e3-8f4554239b87 service nova] Acquiring lock "refresh_cache-e94c4f7c-6e99-4694-84d6-ed62c385a4f9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Updating instance_info_cache with network_info: [{"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Releasing lock "refresh_cache-e94c4f7c-6e99-4694-84d6-ed62c385a4f9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Instance network_info: |[{"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-657ffa2f-a822-422c-ab0d-c3f95ea15330 req-b14fa7d7-bdba-43bd-85e3-8f4554239b87 service nova] Acquired lock "refresh_cache-e94c4f7c-6e99-4694-84d6-ed62c385a4f9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-657ffa2f-a822-422c-ab0d-c3f95ea15330 req-b14fa7d7-bdba-43bd-85e3-8f4554239b87 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Refreshing network info cache for port d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Start _get_guest_xml network_info=[{"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:01:14 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:01:14 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-271667642',display_name='tempest-tempest.common.compute-instance-271667642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-271667642',id=27,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD4PHb/9XzyvWLBbPO6wny4wEPuXFI3gaSrqSdwmjCZkbsuAHJH7SKFqW6FChsnRgIXFl9df68Jt5kVrUhD4iFw8HDLHHScd2I9aHIHob65iYrnC7ObhbXR1SqG3E6kOA==',key_name='tempest-keypair-433171770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-5otvhosk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:01:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=e94c4f7c-6e99-4694-84d6-ed62c385a4f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.objects.instance [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lazy-loading 'pci_devices' on Instance uuid e94c4f7c-6e99-4694-84d6-ed62c385a4f9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:01:14 user nova-compute[74278]:   <uuid>e94c4f7c-6e99-4694-84d6-ed62c385a4f9</uuid>
Oct 30 11:01:14 user nova-compute[74278]:   <name>instance-0000001b</name>
Oct 30 11:01:14 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:01:14 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:01:14 user nova-compute[74278]:   <metadata>
Oct 30 11:01:14 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:01:14 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:01:14 user nova-compute[74278]:       <nova:name>tempest-tempest.common.compute-instance-271667642</nova:name>
Oct 30 11:01:14 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:01:14</nova:creationTime>
Oct 30 11:01:14 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:01:14 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:01:14 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:01:14 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:01:14 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:01:14 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:01:14 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:01:14 user nova-compute[74278]:       <nova:owner>
Oct 30 11:01:14 user nova-compute[74278]:         <nova:user uuid="1b9a38bd9c4e4717b9499ed404ed2d6d">tempest-ServerActionsTestOtherA-1217247754-project-member</nova:user>
Oct 30 11:01:14 user nova-compute[74278]:         <nova:project uuid="d8215346d10443799d5d450114b09386">tempest-ServerActionsTestOtherA-1217247754</nova:project>
Oct 30 11:01:14 user nova-compute[74278]:       </nova:owner>
Oct 30 11:01:14 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:01:14 user nova-compute[74278]:       <nova:ports>
Oct 30 11:01:14 user nova-compute[74278]:         <nova:port uuid="d0cd08c8-6f28-46d3-a6ad-c2b65ef16803">
Oct 30 11:01:14 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 11:01:14 user nova-compute[74278]:         </nova:port>
Oct 30 11:01:14 user nova-compute[74278]:       </nova:ports>
Oct 30 11:01:14 user nova-compute[74278]:     </nova:instance>
Oct 30 11:01:14 user nova-compute[74278]:   </metadata>
Oct 30 11:01:14 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:01:14 user nova-compute[74278]:     <system>
Oct 30 11:01:14 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:01:14 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:01:14 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:01:14 user nova-compute[74278]:       <entry name="serial">e94c4f7c-6e99-4694-84d6-ed62c385a4f9</entry>
Oct 30 11:01:14 user nova-compute[74278]:       <entry name="uuid">e94c4f7c-6e99-4694-84d6-ed62c385a4f9</entry>
Oct 30 11:01:14 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:01:14 user nova-compute[74278]:     </system>
Oct 30 11:01:14 user nova-compute[74278]:   </sysinfo>
Oct 30 11:01:14 user nova-compute[74278]:   <os>
Oct 30 11:01:14 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:01:14 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:01:14 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:01:14 user nova-compute[74278]:   </os>
Oct 30 11:01:14 user nova-compute[74278]:   <features>
Oct 30 11:01:14 user nova-compute[74278]:     <acpi/>
Oct 30 11:01:14 user nova-compute[74278]:     <apic/>
Oct 30 11:01:14 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:01:14 user nova-compute[74278]:   </features>
Oct 30 11:01:14 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:01:14 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:01:14 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:01:14 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:01:14 user nova-compute[74278]:   </clock>
Oct 30 11:01:14 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:01:14 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:01:14 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:01:14 user nova-compute[74278]:   </cpu>
Oct 30 11:01:14 user nova-compute[74278]:   <devices>
Oct 30 11:01:14 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:01:14 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:01:14 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk"/>
Oct 30 11:01:14 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:01:14 user nova-compute[74278]:     </disk>
Oct 30 11:01:14 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:01:14 user nova-compute[74278]:       <mac address="fa:16:3e:f9:3c:94"/>
Oct 30 11:01:14 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:01:14 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:01:14 user nova-compute[74278]:       <target dev="tapd0cd08c8-6f"/>
Oct 30 11:01:14 user nova-compute[74278]:     </interface>
Oct 30 11:01:14 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:01:14 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/console.log" append="off"/>
Oct 30 11:01:14 user nova-compute[74278]:     </serial>
Oct 30 11:01:14 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:01:14 user nova-compute[74278]:     <video>
Oct 30 11:01:14 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:01:14 user nova-compute[74278]:     </video>
Oct 30 11:01:14 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:01:14 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:01:14 user nova-compute[74278]:     </rng>
Oct 30 11:01:14 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:01:14 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:01:14 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:01:14 user nova-compute[74278]:     </memballoon>
Oct 30 11:01:14 user nova-compute[74278]:   </devices>
Oct 30 11:01:14 user nova-compute[74278]: </domain>
Oct 30 11:01:14 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-271667642',display_name='tempest-tempest.common.compute-instance-271667642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-271667642',id=27,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD4PHb/9XzyvWLBbPO6wny4wEPuXFI3gaSrqSdwmjCZkbsuAHJH7SKFqW6FChsnRgIXFl9df68Jt5kVrUhD4iFw8HDLHHScd2I9aHIHob65iYrnC7ObhbXR1SqG3E6kOA==',key_name='tempest-keypair-433171770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-5otvhosk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:01:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=e94c4f7c-6e99-4694-84d6-ed62c385a4f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG os_vif [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0978a9d8-486e-5bf3-96f8-50ca4dc5b4ee', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0cd08c8-6f, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0cd08c8-6f, col_values=(('qos', UUID('403316f6-6d3c-49cd-8e3d-352537b3150b')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0cd08c8-6f, col_values=(('external_ids', {'iface-id': 'd0cd08c8-6f28-46d3-a6ad-c2b65ef16803', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:3c:94', 'vm-uuid': 'e94c4f7c-6e99-4694-84d6-ed62c385a4f9'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:14 user nova-compute[74278]: INFO os_vif [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f')
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:01:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No VIF found with MAC fa:16:3e:f9:3c:94, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:01:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-657ffa2f-a822-422c-ab0d-c3f95ea15330 req-b14fa7d7-bdba-43bd-85e3-8f4554239b87 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Updated VIF entry in instance network info cache for port d0cd08c8-6f28-46d3-a6ad-c2b65ef16803. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:01:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-657ffa2f-a822-422c-ab0d-c3f95ea15330 req-b14fa7d7-bdba-43bd-85e3-8f4554239b87 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Updating instance_info_cache with network_info: [{"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:01:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-657ffa2f-a822-422c-ab0d-c3f95ea15330 req-b14fa7d7-bdba-43bd-85e3-8f4554239b87 service nova] Releasing lock "refresh_cache-e94c4f7c-6e99-4694-84d6-ed62c385a4f9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:01:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:16 user nova-compute[74278]: DEBUG nova.compute.manager [req-1ef1cb7b-dfd8-43ee-9a12-5d8235511977 req-fb2f6569-b1ca-4dc9-97fe-18eddd900afc service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1ef1cb7b-dfd8-43ee-9a12-5d8235511977 req-fb2f6569-b1ca-4dc9-97fe-18eddd900afc service nova] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1ef1cb7b-dfd8-43ee-9a12-5d8235511977 req-fb2f6569-b1ca-4dc9-97fe-18eddd900afc service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1ef1cb7b-dfd8-43ee-9a12-5d8235511977 req-fb2f6569-b1ca-4dc9-97fe-18eddd900afc service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:16 user nova-compute[74278]: DEBUG nova.compute.manager [req-1ef1cb7b-dfd8-43ee-9a12-5d8235511977 req-fb2f6569-b1ca-4dc9-97fe-18eddd900afc service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] No waiting events found dispatching network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:01:16 user nova-compute[74278]: WARNING nova.compute.manager [req-1ef1cb7b-dfd8-43ee-9a12-5d8235511977 req-fb2f6569-b1ca-4dc9-97fe-18eddd900afc service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received unexpected event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 for instance with vm_state building and task_state spawning.
Oct 30 11:01:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-a293940b-8b3b-4ac3-9ea7-34108dea37ce req-84471bbf-ff83-4b43-81b8-9a4de13e9ec9 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a293940b-8b3b-4ac3-9ea7-34108dea37ce req-84471bbf-ff83-4b43-81b8-9a4de13e9ec9 service nova] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a293940b-8b3b-4ac3-9ea7-34108dea37ce req-84471bbf-ff83-4b43-81b8-9a4de13e9ec9 service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a293940b-8b3b-4ac3-9ea7-34108dea37ce req-84471bbf-ff83-4b43-81b8-9a4de13e9ec9 service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-a293940b-8b3b-4ac3-9ea7-34108dea37ce req-84471bbf-ff83-4b43-81b8-9a4de13e9ec9 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] No waiting events found dispatching network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:01:18 user nova-compute[74278]: WARNING nova.compute.manager [req-a293940b-8b3b-4ac3-9ea7-34108dea37ce req-84471bbf-ff83-4b43-81b8-9a4de13e9ec9 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received unexpected event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 for instance with vm_state building and task_state spawning.
Oct 30 11:01:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:01:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:01:18 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Instance spawned successfully.
Oct 30 11:01:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:01:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:18 user nova-compute[74278]: INFO nova.compute.manager [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Took 6.08 seconds to spawn the instance on the hypervisor.
Oct 30 11:01:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:01:18 user nova-compute[74278]: INFO nova.compute.manager [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Took 7.13 seconds to build instance.
Oct 30 11:01:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f77f4422-379c-4f4f-8fc4-aa34efa2125c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.234s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:23 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:01:23 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:01:24 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:01:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:01:24 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:01:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74278) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 11:01:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:25 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:01:26 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:01:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:01:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:01:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:01:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:01:27 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Updating instance_info_cache with network_info: [{"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:01:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:01:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:01:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:01:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:01:28 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Creating image(s)
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Ensure instance console log exists: /opt/stack/data/nova/instances/3d76b06b-9009-4879-83f4-819b1d20ce6c/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Start _get_guest_xml network_info=[{"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWlZnusY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d76b06b-9009-4879-83f4-819b1d20ce6c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 'serial': 'c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce'}, 'attachment_id': '3ea53b23-ed99-46d7-82ab-c63ac28d64ea', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:01:28 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:01:28 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWlZnusY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:01:28 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:01:28 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:01:28 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c3f0de-89b2-4bbc-a871-9553498c8ce9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:01:28 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e070eb-bd3e-4555-8127-82f5482cc314]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce] added
Oct 30 11:01:28 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcc1d82-ad96-4f81-9a35-84020c4c5e25]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b93730-985d-4e8e-bddc-280680d7da12]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWlZnusY {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-74c0a168-132c-45c7-ba7b-076c69cba132 req-dc8315e2-dd68-431f-b6fd-4b5b6c3b08b9 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Received event network-changed-42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-74c0a168-132c-45c7-ba7b-076c69cba132 req-dc8315e2-dd68-431f-b6fd-4b5b6c3b08b9 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Refreshing instance network info cache due to event network-changed-42f486b0-bbf0-41a3-b93a-1647f97bf631. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-74c0a168-132c-45c7-ba7b-076c69cba132 req-dc8315e2-dd68-431f-b6fd-4b5b6c3b08b9 service nova] Acquiring lock "refresh_cache-23852f7e-6e4a-4e19-91ff-d9914c04cf83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-74c0a168-132c-45c7-ba7b-076c69cba132 req-dc8315e2-dd68-431f-b6fd-4b5b6c3b08b9 service nova] Acquired lock "refresh_cache-23852f7e-6e4a-4e19-91ff-d9914c04cf83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG nova.network.neutron [req-74c0a168-132c-45c7-ba7b-076c69cba132 req-dc8315e2-dd68-431f-b6fd-4b5b6c3b08b9 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Refreshing network info cache for port 42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWlZnusY" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd5fe50-5dc2-4be8-b77c-ac2b07395667]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eWlZnusY'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c7f89d-455d-4137-862c-cce0bd76a4f1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[799ad0fb-d898-42b7-a7c9-1e6085e3debd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:01:28 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:01:28 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1430509a-7bac-44a4-bfac-40e624e14d31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260]
Oct 30 11:01:28 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260] successful.
Oct 30 11:01:28 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[16982832-71aa-4ecc-841f-a5608c4834b0]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad19458-da76-4c5e-90f5-73443be07b51]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:01:28 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:01:28 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:01:28 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:01:28 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2b317c-bc61-4cfc-aa94-a238f06a9757]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:01:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWlZnusY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG nova.network.neutron [req-74c0a168-132c-45c7-ba7b-076c69cba132 req-dc8315e2-dd68-431f-b6fd-4b5b6c3b08b9 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Updated VIF entry in instance network info cache for port 42f486b0-bbf0-41a3-b93a-1647f97bf631. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG nova.network.neutron [req-74c0a168-132c-45c7-ba7b-076c69cba132 req-dc8315e2-dd68-431f-b6fd-4b5b6c3b08b9 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Updating instance_info_cache with network_info: [{"id": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "address": "fa:16:3e:37:3e:a6", "network": {"id": "e3277ec0-08f4-4186-8b28-31a9c9112aac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1499901778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2474a648f3b48ac9a43b07b77f9d6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42f486b0-bb", "ovs_interfaceid": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-74c0a168-132c-45c7-ba7b-076c69cba132 req-dc8315e2-dd68-431f-b6fd-4b5b6c3b08b9 service nova] Releasing lock "refresh_cache-23852f7e-6e4a-4e19-91ff-d9914c04cf83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:29 user nova-compute[74278]: INFO nova.compute.manager [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Terminating instance
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26230616432656238', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230616432656238', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1641223937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1641223937',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHVmrqblopLInY1Wvk20+mn5oY9HK3qJoDsTdzD86gNKR60O24Sw37vqqe1SrB61PQcGQ4FQ4hLz1IfnqJniiFuJlMlaNcPIwOFFcbpXS/Op3g50/gRu7VGHSf0Wg5YEw==',key_name='tempest-keypair-1295466818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2c85eda9534f06bd5d7db1300d1f73',ramdisk_id='',reservation_id='r-mt0ozl4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-632878584',owner_user_name='tempest-ServerActionsV293TestJSON-632878584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e7bb5f85c254f3d9febe9dc037a8459',uuid=3d76b06b-9009-4879-83f4-819b1d20ce6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Converting VIF {"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d76b06b-9009-4879-83f4-819b1d20ce6c {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:01:30 user nova-compute[74278]:   <uuid>3d76b06b-9009-4879-83f4-819b1d20ce6c</uuid>
Oct 30 11:01:30 user nova-compute[74278]:   <name>instance-0000001a</name>
Oct 30 11:01:30 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:01:30 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:01:30 user nova-compute[74278]:   <metadata>
Oct 30 11:01:30 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:01:30 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:01:30 user nova-compute[74278]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1641223937</nova:name>
Oct 30 11:01:30 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:01:28</nova:creationTime>
Oct 30 11:01:30 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:01:30 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:01:30 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:01:30 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:01:30 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:01:30 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:01:30 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:01:30 user nova-compute[74278]:       <nova:owner>
Oct 30 11:01:30 user nova-compute[74278]:         <nova:user uuid="6e7bb5f85c254f3d9febe9dc037a8459">tempest-ServerActionsV293TestJSON-632878584-project-member</nova:user>
Oct 30 11:01:30 user nova-compute[74278]:         <nova:project uuid="0e2c85eda9534f06bd5d7db1300d1f73">tempest-ServerActionsV293TestJSON-632878584</nova:project>
Oct 30 11:01:30 user nova-compute[74278]:       </nova:owner>
Oct 30 11:01:30 user nova-compute[74278]:       <nova:ports>
Oct 30 11:01:30 user nova-compute[74278]:         <nova:port uuid="8fac0256-08e9-4391-9b63-41b420e15539">
Oct 30 11:01:30 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 11:01:30 user nova-compute[74278]:         </nova:port>
Oct 30 11:01:30 user nova-compute[74278]:       </nova:ports>
Oct 30 11:01:30 user nova-compute[74278]:     </nova:instance>
Oct 30 11:01:30 user nova-compute[74278]:   </metadata>
Oct 30 11:01:30 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:01:30 user nova-compute[74278]:     <system>
Oct 30 11:01:30 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:01:30 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:01:30 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:01:30 user nova-compute[74278]:       <entry name="serial">3d76b06b-9009-4879-83f4-819b1d20ce6c</entry>
Oct 30 11:01:30 user nova-compute[74278]:       <entry name="uuid">3d76b06b-9009-4879-83f4-819b1d20ce6c</entry>
Oct 30 11:01:30 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:01:30 user nova-compute[74278]:     </system>
Oct 30 11:01:30 user nova-compute[74278]:   </sysinfo>
Oct 30 11:01:30 user nova-compute[74278]:   <os>
Oct 30 11:01:30 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:01:30 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:01:30 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:01:30 user nova-compute[74278]:   </os>
Oct 30 11:01:30 user nova-compute[74278]:   <features>
Oct 30 11:01:30 user nova-compute[74278]:     <acpi/>
Oct 30 11:01:30 user nova-compute[74278]:     <apic/>
Oct 30 11:01:30 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:01:30 user nova-compute[74278]:   </features>
Oct 30 11:01:30 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:01:30 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:01:30 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:01:30 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:01:30 user nova-compute[74278]:   </clock>
Oct 30 11:01:30 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:01:30 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:01:30 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:01:30 user nova-compute[74278]:   </cpu>
Oct 30 11:01:30 user nova-compute[74278]:   <devices>
Oct 30 11:01:30 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:01:30 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:01:30 user nova-compute[74278]:       <source dev="/dev/sdb"/>
Oct 30 11:01:30 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:01:30 user nova-compute[74278]:       <serial>c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce</serial>
Oct 30 11:01:30 user nova-compute[74278]:     </disk>
Oct 30 11:01:30 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:01:30 user nova-compute[74278]:       <mac address="fa:16:3e:9c:e3:8e"/>
Oct 30 11:01:30 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:01:30 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:01:30 user nova-compute[74278]:       <target dev="tap8fac0256-08"/>
Oct 30 11:01:30 user nova-compute[74278]:     </interface>
Oct 30 11:01:30 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:01:30 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/3d76b06b-9009-4879-83f4-819b1d20ce6c/console.log" append="off"/>
Oct 30 11:01:30 user nova-compute[74278]:     </serial>
Oct 30 11:01:30 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:01:30 user nova-compute[74278]:     <video>
Oct 30 11:01:30 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:01:30 user nova-compute[74278]:     </video>
Oct 30 11:01:30 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:01:30 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:01:30 user nova-compute[74278]:     </rng>
Oct 30 11:01:30 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:01:30 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:01:30 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:01:30 user nova-compute[74278]:     </memballoon>
Oct 30 11:01:30 user nova-compute[74278]:   </devices>
Oct 30 11:01:30 user nova-compute[74278]: </domain>
Oct 30 11:01:30 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1641223937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1641223937',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHVmrqblopLInY1Wvk20+mn5oY9HK3qJoDsTdzD86gNKR60O24Sw37vqqe1SrB61PQcGQ4FQ4hLz1IfnqJniiFuJlMlaNcPIwOFFcbpXS/Op3g50/gRu7VGHSf0Wg5YEw==',key_name='tempest-keypair-1295466818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e2c85eda9534f06bd5d7db1300d1f73',ramdisk_id='',reservation_id='r-mt0ozl4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-632878584',owner_user_name='tempest-ServerActionsV293TestJSON-632878584-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e7bb5f85c254f3d9febe9dc037a8459',uuid=3d76b06b-9009-4879-83f4-819b1d20ce6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Converting VIF {"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG os_vif [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08f857d6-d2f8-5fae-9a95-de41a7fe3762', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fac0256-08, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fac0256-08, col_values=(('qos', UUID('50b5b126-3364-42d4-be45-5d2f37e4af7e')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fac0256-08, col_values=(('external_ids', {'iface-id': '8fac0256-08e9-4391-9b63-41b420e15539', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:e3:8e', 'vm-uuid': '3d76b06b-9009-4879-83f4-819b1d20ce6c'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:30 user nova-compute[74278]: INFO os_vif [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08')
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] No VIF found with MAC fa:16:3e:9c:e3:8e, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-17b9fb16-bc0d-481f-87e2-1bdc2c5c3a5d req-1111cd1b-66b3-486b-a8c1-d925894919ba service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Received event network-vif-unplugged-a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-17b9fb16-bc0d-481f-87e2-1bdc2c5c3a5d req-1111cd1b-66b3-486b-a8c1-d925894919ba service nova] Acquiring lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-17b9fb16-bc0d-481f-87e2-1bdc2c5c3a5d req-1111cd1b-66b3-486b-a8c1-d925894919ba service nova] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-17b9fb16-bc0d-481f-87e2-1bdc2c5c3a5d req-1111cd1b-66b3-486b-a8c1-d925894919ba service nova] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-17b9fb16-bc0d-481f-87e2-1bdc2c5c3a5d req-1111cd1b-66b3-486b-a8c1-d925894919ba service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] No waiting events found dispatching network-vif-unplugged-a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-17b9fb16-bc0d-481f-87e2-1bdc2c5c3a5d req-1111cd1b-66b3-486b-a8c1-d925894919ba service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Received event network-vif-unplugged-a7c51798-cdc7-4e93-992e-38005422a757 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-6aff8839-5c84-43bb-98c7-9985f6822da6 req-c7ddb5d2-d6e1-4d81-962c-ea2a80e1c500 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Received event network-changed-a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-6aff8839-5c84-43bb-98c7-9985f6822da6 req-c7ddb5d2-d6e1-4d81-962c-ea2a80e1c500 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Refreshing instance network info cache due to event network-changed-a7c51798-cdc7-4e93-992e-38005422a757. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6aff8839-5c84-43bb-98c7-9985f6822da6 req-c7ddb5d2-d6e1-4d81-962c-ea2a80e1c500 service nova] Acquiring lock "refresh_cache-a6ad2df0-d37c-43f8-bb93-1fb3894b4593" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6aff8839-5c84-43bb-98c7-9985f6822da6 req-c7ddb5d2-d6e1-4d81-962c-ea2a80e1c500 service nova] Acquired lock "refresh_cache-a6ad2df0-d37c-43f8-bb93-1fb3894b4593" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG nova.network.neutron [req-6aff8839-5c84-43bb-98c7-9985f6822da6 req-c7ddb5d2-d6e1-4d81-962c-ea2a80e1c500 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Refreshing network info cache for port a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:31 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Instance destroyed successfully.
Oct 30 11:01:31 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lazy-loading 'resources' on Instance uuid a6ad2df0-d37c-43f8-bb93-1fb3894b4593 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1922749226',display_name='tempest-TestStampPattern-server-1922749226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1922749226',id=21,image_ref='19d820c7-6c21-4ce1-9c3c-275e4d340999',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErJIPGly6W6lNejwEf8DtSNy5OrG6xfE/nDhPvCgU8od+RfEYPhZ5Qc+GqAO9q9/7KpAJWL/Kivlo794MTyR38r0U10CkXp6EajAwqkYjjkVym0Mb+QFcYi/6SagifxZw==',key_name='tempest-TestStampPattern-1979010860',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ba4eff185f543aa8c590fe74f59c7b8',ramdisk_id='',reservation_id='r-c2kjz2kl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9cba7c39-a2d1-44c0-a866-01c22a3f3634',image_min_disk='1',image_min_ram='0',image_owner_id='0ba4eff185f543aa8c590fe74f59c7b8',image_owner_project_name='tempest-TestStampPattern-1462524641',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1462524641-project-member',image_user_id='0c4560d0bf034d30a8d8d6fac7d347f8',owner_project_name='tempest-TestStampPattern-1462524641',owner_user_name='tempest-TestStampPattern-1462524641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:58:32Z,user_data=None,user_id='0c4560d0bf034d30a8d8d6fac7d347f8',uuid=a6ad2df0-d37c-43f8-bb93-1fb3894b4593,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7c51798-cdc7-4e93-992e-38005422a757", "address": "fa:16:3e:55:71:cd", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c51798-cd", "ovs_interfaceid": "a7c51798-cdc7-4e93-992e-38005422a757", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Converting VIF {"id": "a7c51798-cdc7-4e93-992e-38005422a757", "address": "fa:16:3e:55:71:cd", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c51798-cd", "ovs_interfaceid": "a7c51798-cdc7-4e93-992e-38005422a757", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=a7c51798-cdc7-4e93-992e-38005422a757,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c51798-cd') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG os_vif [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=a7c51798-cdc7-4e93-992e-38005422a757,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c51798-cd') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7c51798-cd, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef3e7677-4f27-444c-8b83-bb7d5e31b2c5) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:31 user nova-compute[74278]: INFO os_vif [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:71:cd,bridge_name='br-int',has_traffic_filtering=True,id=a7c51798-cdc7-4e93-992e-38005422a757,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7c51798-cd')
Oct 30 11:01:31 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Deleting instance files /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593_del
Oct 30 11:01:31 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Deletion of /opt/stack/data/nova/instances/a6ad2df0-d37c-43f8-bb93-1fb3894b4593_del complete
Oct 30 11:01:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG nova.network.neutron [req-6aff8839-5c84-43bb-98c7-9985f6822da6 req-c7ddb5d2-d6e1-4d81-962c-ea2a80e1c500 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Updated VIF entry in instance network info cache for port a7c51798-cdc7-4e93-992e-38005422a757. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG nova.network.neutron [req-6aff8839-5c84-43bb-98c7-9985f6822da6 req-c7ddb5d2-d6e1-4d81-962c-ea2a80e1c500 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Updating instance_info_cache with network_info: [{"id": "a7c51798-cdc7-4e93-992e-38005422a757", "address": "fa:16:3e:55:71:cd", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7c51798-cd", "ovs_interfaceid": "a7c51798-cdc7-4e93-992e-38005422a757", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:01:31 user nova-compute[74278]: INFO nova.compute.manager [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Took 1.51 seconds to destroy the instance on the hypervisor.
Oct 30 11:01:31 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6aff8839-5c84-43bb-98c7-9985f6822da6 req-c7ddb5d2-d6e1-4d81-962c-ea2a80e1c500 service nova] Releasing lock "refresh_cache-a6ad2df0-d37c-43f8-bb93-1fb3894b4593" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:31 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid 'a6ad2df0-d37c-43f8-bb93-1fb3894b4593' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a6ad2df0-d37c-43f8-bb93-1fb3894b4593' (instance-00000015)
Oct 30 11:01:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:31 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:32 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Took 0.73 seconds to deallocate network for instance.
Oct 30 11:01:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG nova.compute.manager [req-d98e1492-910c-44e5-b914-11741e722ae2 req-a47265db-0ae2-476c-a8f3-059158b60434 service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Received event network-vif-deleted-a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Refreshing inventories for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Updating ProviderTree inventory for provider ce405684-67ab-45d9-bc83-6af4903bfb15 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Updating inventory in ProviderTree for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Refreshing aggregate associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, aggregates: None {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Refreshing trait associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 11:01:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.manager [req-5cf7dc1d-f3d5-4278-b382-32d6d6877ab0 req-811a0d54-50d0-41d8-9848-72dd1f35008f service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Received event network-vif-plugged-a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5cf7dc1d-f3d5-4278-b382-32d6d6877ab0 req-811a0d54-50d0-41d8-9848-72dd1f35008f service nova] Acquiring lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5cf7dc1d-f3d5-4278-b382-32d6d6877ab0 req-811a0d54-50d0-41d8-9848-72dd1f35008f service nova] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5cf7dc1d-f3d5-4278-b382-32d6d6877ab0 req-811a0d54-50d0-41d8-9848-72dd1f35008f service nova] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.manager [req-5cf7dc1d-f3d5-4278-b382-32d6d6877ab0 req-811a0d54-50d0-41d8-9848-72dd1f35008f service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] No waiting events found dispatching network-vif-plugged-a7c51798-cdc7-4e93-992e-38005422a757 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:01:33 user nova-compute[74278]: WARNING nova.compute.manager [req-5cf7dc1d-f3d5-4278-b382-32d6d6877ab0 req-811a0d54-50d0-41d8-9848-72dd1f35008f service nova] [instance: a6ad2df0-d37c-43f8-bb93-1fb3894b4593] Received unexpected event network-vif-plugged-a7c51798-cdc7-4e93-992e-38005422a757 for instance with vm_state deleted and task_state None.
Oct 30 11:01:33 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:01:33 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7548MB free_disk=24.828258514404297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.309s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.260s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:33 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Deleted allocations for instance a6ad2df0-d37c-43f8-bb93-1fb3894b4593
Oct 30 11:01:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9de594b0-b1a9-438a-86b6-c3ad16d7782e tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "a6ad2df0-d37c-43f8-bb93-1fb3894b4593" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.918s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 64287717-7d3b-4087-aedf-faf87be774a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2b8efca4-cec4-4179-99af-92172f9b8a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 23852f7e-6e4a-4e19-91ff-d9914c04cf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 3d76b06b-9009-4879-83f4-819b1d20ce6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:01:33 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.518s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.compute.manager [req-01cb397d-5eae-47ff-ab06-1cdd243beb18 req-78ba9f70-12f4-4c78-9ed4-ce891b786efb service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-01cb397d-5eae-47ff-ab06-1cdd243beb18 req-78ba9f70-12f4-4c78-9ed4-ce891b786efb service nova] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-01cb397d-5eae-47ff-ab06-1cdd243beb18 req-78ba9f70-12f4-4c78-9ed4-ce891b786efb service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-01cb397d-5eae-47ff-ab06-1cdd243beb18 req-78ba9f70-12f4-4c78-9ed4-ce891b786efb service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.compute.manager [req-01cb397d-5eae-47ff-ab06-1cdd243beb18 req-78ba9f70-12f4-4c78-9ed4-ce891b786efb service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] No waiting events found dispatching network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:01:34 user nova-compute[74278]: WARNING nova.compute.manager [req-01cb397d-5eae-47ff-ab06-1cdd243beb18 req-78ba9f70-12f4-4c78-9ed4-ce891b786efb service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received unexpected event network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 for instance with vm_state building and task_state spawning.
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.compute.manager [req-01cb397d-5eae-47ff-ab06-1cdd243beb18 req-78ba9f70-12f4-4c78-9ed4-ce891b786efb service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-01cb397d-5eae-47ff-ab06-1cdd243beb18 req-78ba9f70-12f4-4c78-9ed4-ce891b786efb service nova] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-01cb397d-5eae-47ff-ab06-1cdd243beb18 req-78ba9f70-12f4-4c78-9ed4-ce891b786efb service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-01cb397d-5eae-47ff-ab06-1cdd243beb18 req-78ba9f70-12f4-4c78-9ed4-ce891b786efb service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.compute.manager [req-01cb397d-5eae-47ff-ab06-1cdd243beb18 req-78ba9f70-12f4-4c78-9ed4-ce891b786efb service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] No waiting events found dispatching network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:01:34 user nova-compute[74278]: WARNING nova.compute.manager [req-01cb397d-5eae-47ff-ab06-1cdd243beb18 req-78ba9f70-12f4-4c78-9ed4-ce891b786efb service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received unexpected event network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 for instance with vm_state building and task_state spawning.
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:01:34 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Instance spawned successfully.
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:34 user nova-compute[74278]: INFO nova.compute.manager [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Took 6.03 seconds to spawn the instance on the hypervisor.
Oct 30 11:01:34 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:01:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:34 user nova-compute[74278]: INFO nova.compute.manager [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Took 28.84 seconds to build instance.
Oct 30 11:01:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1cc9163a-8828-43ce-a989-9ba6c5ef0f80 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.959s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG nova.objects.instance [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lazy-loading 'flavor' on Instance uuid 23852f7e-6e4a-4e19-91ff-d9914c04cf83 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:36 user nova-compute[74278]: INFO nova.compute.manager [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Attaching volume 27bd78ea-b688-4697-8050-bc5fdde54b22 to /dev/vdb
Oct 30 11:01:36 user nova-compute[74278]: DEBUG os_brick.utils [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd38c8ca-7f1c-4a08-9be6-8e69a42f25e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c2d3ec-4dab-4332-a19e-8c3572df11f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[71799be8-81d3-46bb-a11d-b1911ea66937]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa85c627-4ef6-4f35-a25b-1b230ccc346e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:01:36 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:01:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c144d331-a379-42d3-9180-d75a2380cabb]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG os_brick.utils [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:01:36 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Updating existing volume attachment record: 84ab5d99-0bb4-4895-afb7-b261908cb907 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:01:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:01:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:01:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 11:01:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] There are 0 instances to clean {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 11:01:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG nova.compute.manager [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:01:50 user nova-compute[74278]: INFO nova.compute.claims [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Claim successful on node user
Oct 30 11:01:50 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG nova.compute.manager [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG nova.compute.manager [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG nova.network.neutron [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:01:50 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:01:50 user nova-compute[74278]: DEBUG nova.compute.manager [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG nova.policy [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31e7e6847ec0415fba0fd909c014e802', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43bf73deda348f08290daf640768705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG nova.compute.manager [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:01:50 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Creating image(s)
Oct 30 11:01:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "/opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "/opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.168s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk 1073741824" returned: 0 in 0.049s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG nova.network.neutron [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Successfully created port: 3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.206s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Cannot resize image /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Ensure instance console log exists: /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.network.neutron [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Successfully updated port: 3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "refresh_cache-ef2b0994-a1be-49f5-8617-7fedfeaeca6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquired lock "refresh_cache-ef2b0994-a1be-49f5-8617-7fedfeaeca6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.network.neutron [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.compute.manager [req-bbc65a94-caae-4c53-bac8-104319d8c807 req-738fd8f4-c08a-4c89-9078-fb789f9baded service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-changed-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.compute.manager [req-bbc65a94-caae-4c53-bac8-104319d8c807 req-738fd8f4-c08a-4c89-9078-fb789f9baded service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Refreshing instance network info cache due to event network-changed-3138d8fd-1eed-4c93-ad49-bddc7e9bed81. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bbc65a94-caae-4c53-bac8-104319d8c807 req-738fd8f4-c08a-4c89-9078-fb789f9baded service nova] Acquiring lock "refresh_cache-ef2b0994-a1be-49f5-8617-7fedfeaeca6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.network.neutron [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.network.neutron [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Updating instance_info_cache with network_info: [{"id": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "address": "fa:16:3e:59:0c:4c", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3138d8fd-1e", "ovs_interfaceid": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Releasing lock "refresh_cache-ef2b0994-a1be-49f5-8617-7fedfeaeca6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.compute.manager [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Instance network_info: |[{"id": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "address": "fa:16:3e:59:0c:4c", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3138d8fd-1e", "ovs_interfaceid": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bbc65a94-caae-4c53-bac8-104319d8c807 req-738fd8f4-c08a-4c89-9078-fb789f9baded service nova] Acquired lock "refresh_cache-ef2b0994-a1be-49f5-8617-7fedfeaeca6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.network.neutron [req-bbc65a94-caae-4c53-bac8-104319d8c807 req-738fd8f4-c08a-4c89-9078-fb789f9baded service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Refreshing network info cache for port 3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Start _get_guest_xml network_info=[{"id": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "address": "fa:16:3e:59:0c:4c", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3138d8fd-1e", "ovs_interfaceid": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:01:52 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:01:52 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-743465971',display_name='tempest-AttachVolumeNegativeTest-server-743465971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-743465971',id=28,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLn3Us0FIKYgjui5Xn5D60bg+l2VlVAg3Prk/TVIxKtCfFcUlgT4NaSoRl0wx0HQXx9fJzwdz4+ZltJlhR6Uq95wYJVfADSCeWNfD5taZ+QbT4wNhCliKMGsju9Duwt0Q==',key_name='tempest-keypair-1353853241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43bf73deda348f08290daf640768705',ramdisk_id='',reservation_id='r-ln87t0d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-871157650',owner_user_name='tempest-AttachVolumeNegativeTest-871157650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:01:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31e7e6847ec0415fba0fd909c014e802',uuid=ef2b0994-a1be-49f5-8617-7fedfeaeca6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "address": "fa:16:3e:59:0c:4c", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3138d8fd-1e", "ovs_interfaceid": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converting VIF {"id": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "address": "fa:16:3e:59:0c:4c", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3138d8fd-1e", "ovs_interfaceid": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:0c:4c,bridge_name='br-int',has_traffic_filtering=True,id=3138d8fd-1eed-4c93-ad49-bddc7e9bed81,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3138d8fd-1e') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.objects.instance [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'pci_devices' on Instance uuid ef2b0994-a1be-49f5-8617-7fedfeaeca6c {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:01:52 user nova-compute[74278]:   <uuid>ef2b0994-a1be-49f5-8617-7fedfeaeca6c</uuid>
Oct 30 11:01:52 user nova-compute[74278]:   <name>instance-0000001c</name>
Oct 30 11:01:52 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:01:52 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:01:52 user nova-compute[74278]:   <metadata>
Oct 30 11:01:52 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:01:52 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:01:52 user nova-compute[74278]:       <nova:name>tempest-AttachVolumeNegativeTest-server-743465971</nova:name>
Oct 30 11:01:52 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:01:52</nova:creationTime>
Oct 30 11:01:52 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:01:52 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:01:52 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:01:52 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:01:52 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:01:52 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:01:52 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:01:52 user nova-compute[74278]:       <nova:owner>
Oct 30 11:01:52 user nova-compute[74278]:         <nova:user uuid="31e7e6847ec0415fba0fd909c014e802">tempest-AttachVolumeNegativeTest-871157650-project-member</nova:user>
Oct 30 11:01:52 user nova-compute[74278]:         <nova:project uuid="b43bf73deda348f08290daf640768705">tempest-AttachVolumeNegativeTest-871157650</nova:project>
Oct 30 11:01:52 user nova-compute[74278]:       </nova:owner>
Oct 30 11:01:52 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:01:52 user nova-compute[74278]:       <nova:ports>
Oct 30 11:01:52 user nova-compute[74278]:         <nova:port uuid="3138d8fd-1eed-4c93-ad49-bddc7e9bed81">
Oct 30 11:01:52 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 11:01:52 user nova-compute[74278]:         </nova:port>
Oct 30 11:01:52 user nova-compute[74278]:       </nova:ports>
Oct 30 11:01:52 user nova-compute[74278]:     </nova:instance>
Oct 30 11:01:52 user nova-compute[74278]:   </metadata>
Oct 30 11:01:52 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:01:52 user nova-compute[74278]:     <system>
Oct 30 11:01:52 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:01:52 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:01:52 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:01:52 user nova-compute[74278]:       <entry name="serial">ef2b0994-a1be-49f5-8617-7fedfeaeca6c</entry>
Oct 30 11:01:52 user nova-compute[74278]:       <entry name="uuid">ef2b0994-a1be-49f5-8617-7fedfeaeca6c</entry>
Oct 30 11:01:52 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:01:52 user nova-compute[74278]:     </system>
Oct 30 11:01:52 user nova-compute[74278]:   </sysinfo>
Oct 30 11:01:52 user nova-compute[74278]:   <os>
Oct 30 11:01:52 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:01:52 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:01:52 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:01:52 user nova-compute[74278]:   </os>
Oct 30 11:01:52 user nova-compute[74278]:   <features>
Oct 30 11:01:52 user nova-compute[74278]:     <acpi/>
Oct 30 11:01:52 user nova-compute[74278]:     <apic/>
Oct 30 11:01:52 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:01:52 user nova-compute[74278]:   </features>
Oct 30 11:01:52 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:01:52 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:01:52 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:01:52 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:01:52 user nova-compute[74278]:   </clock>
Oct 30 11:01:52 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:01:52 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:01:52 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:01:52 user nova-compute[74278]:   </cpu>
Oct 30 11:01:52 user nova-compute[74278]:   <devices>
Oct 30 11:01:52 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:01:52 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:01:52 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk"/>
Oct 30 11:01:52 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:01:52 user nova-compute[74278]:     </disk>
Oct 30 11:01:52 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:01:52 user nova-compute[74278]:       <mac address="fa:16:3e:59:0c:4c"/>
Oct 30 11:01:52 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:01:52 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:01:52 user nova-compute[74278]:       <target dev="tap3138d8fd-1e"/>
Oct 30 11:01:52 user nova-compute[74278]:     </interface>
Oct 30 11:01:52 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:01:52 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/console.log" append="off"/>
Oct 30 11:01:52 user nova-compute[74278]:     </serial>
Oct 30 11:01:52 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:01:52 user nova-compute[74278]:     <video>
Oct 30 11:01:52 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:01:52 user nova-compute[74278]:     </video>
Oct 30 11:01:52 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:01:52 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:01:52 user nova-compute[74278]:     </rng>
Oct 30 11:01:52 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:01:52 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:01:52 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:01:52 user nova-compute[74278]:     </memballoon>
Oct 30 11:01:52 user nova-compute[74278]:   </devices>
Oct 30 11:01:52 user nova-compute[74278]: </domain>
Oct 30 11:01:52 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-743465971',display_name='tempest-AttachVolumeNegativeTest-server-743465971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-743465971',id=28,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLn3Us0FIKYgjui5Xn5D60bg+l2VlVAg3Prk/TVIxKtCfFcUlgT4NaSoRl0wx0HQXx9fJzwdz4+ZltJlhR6Uq95wYJVfADSCeWNfD5taZ+QbT4wNhCliKMGsju9Duwt0Q==',key_name='tempest-keypair-1353853241',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b43bf73deda348f08290daf640768705',ramdisk_id='',reservation_id='r-ln87t0d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-871157650',owner_user_name='tempest-AttachVolumeNegativeTest-871157650-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:01:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31e7e6847ec0415fba0fd909c014e802',uuid=ef2b0994-a1be-49f5-8617-7fedfeaeca6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "address": "fa:16:3e:59:0c:4c", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3138d8fd-1e", "ovs_interfaceid": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converting VIF {"id": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "address": "fa:16:3e:59:0c:4c", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3138d8fd-1e", "ovs_interfaceid": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:0c:4c,bridge_name='br-int',has_traffic_filtering=True,id=3138d8fd-1eed-4c93-ad49-bddc7e9bed81,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3138d8fd-1e') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG os_vif [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:0c:4c,bridge_name='br-int',has_traffic_filtering=True,id=3138d8fd-1eed-4c93-ad49-bddc7e9bed81,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3138d8fd-1e') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36efbc66-34e4-5c88-80f6-f9648618fa89', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3138d8fd-1e, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3138d8fd-1e, col_values=(('qos', UUID('ff5c963f-f1bb-4c14-9a13-e1265fbac1cf')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3138d8fd-1e, col_values=(('external_ids', {'iface-id': '3138d8fd-1eed-4c93-ad49-bddc7e9bed81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:0c:4c', 'vm-uuid': 'ef2b0994-a1be-49f5-8617-7fedfeaeca6c'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:52 user nova-compute[74278]: INFO os_vif [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:0c:4c,bridge_name='br-int',has_traffic_filtering=True,id=3138d8fd-1eed-4c93-ad49-bddc7e9bed81,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3138d8fd-1e')
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No VIF found with MAC fa:16:3e:59:0c:4c, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.network.neutron [req-bbc65a94-caae-4c53-bac8-104319d8c807 req-738fd8f4-c08a-4c89-9078-fb789f9baded service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Updated VIF entry in instance network info cache for port 3138d8fd-1eed-4c93-ad49-bddc7e9bed81. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG nova.network.neutron [req-bbc65a94-caae-4c53-bac8-104319d8c807 req-738fd8f4-c08a-4c89-9078-fb789f9baded service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Updating instance_info_cache with network_info: [{"id": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "address": "fa:16:3e:59:0c:4c", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3138d8fd-1e", "ovs_interfaceid": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:01:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bbc65a94-caae-4c53-bac8-104319d8c807 req-738fd8f4-c08a-4c89-9078-fb789f9baded service nova] Releasing lock "refresh_cache-ef2b0994-a1be-49f5-8617-7fedfeaeca6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-657873bd-a08a-4b42-af57-1331fc7e24a6 req-01c7db1e-93a9-4886-94f0-dd1d2875b978 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-657873bd-a08a-4b42-af57-1331fc7e24a6 req-01c7db1e-93a9-4886-94f0-dd1d2875b978 service nova] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-657873bd-a08a-4b42-af57-1331fc7e24a6 req-01c7db1e-93a9-4886-94f0-dd1d2875b978 service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-657873bd-a08a-4b42-af57-1331fc7e24a6 req-01c7db1e-93a9-4886-94f0-dd1d2875b978 service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-657873bd-a08a-4b42-af57-1331fc7e24a6 req-01c7db1e-93a9-4886-94f0-dd1d2875b978 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] No waiting events found dispatching network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:01:54 user nova-compute[74278]: WARNING nova.compute.manager [req-657873bd-a08a-4b42-af57-1331fc7e24a6 req-01c7db1e-93a9-4886-94f0-dd1d2875b978 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received unexpected event network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 for instance with vm_state building and task_state spawning.
Oct 30 11:01:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRVZpxju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:01:56 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:01:56 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:01:56 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8e04db-8fa3-418b-9fe0-28da0012e5ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:01:56 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fda0a6-0d0c-493a-b2f6-b818fa0650b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22] added
Oct 30 11:01:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7a01ca-7e42-402e-80a6-7d8daefcb4c3]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:01:56 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Instance spawned successfully.
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1942b461-a5dc-4e12-8001-94a80e2944b5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRVZpxju {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRVZpxju" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[716af027-9e15-4f19-a523-8135f711efe7]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PRVZpxju'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd092cc-c881-4dd2-a919-d26f4d87824b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-9ed9f130-9fcc-46d1-bcc4-f444b79fd16d req-b0a9000f-cd2b-44b8-8a1a-ceed76133220 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9ed9f130-9fcc-46d1-bcc4-f444b79fd16d req-b0a9000f-cd2b-44b8-8a1a-ceed76133220 service nova] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9ed9f130-9fcc-46d1-bcc4-f444b79fd16d req-b0a9000f-cd2b-44b8-8a1a-ceed76133220 service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9ed9f130-9fcc-46d1-bcc4-f444b79fd16d req-b0a9000f-cd2b-44b8-8a1a-ceed76133220 service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-9ed9f130-9fcc-46d1-bcc4-f444b79fd16d req-b0a9000f-cd2b-44b8-8a1a-ceed76133220 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] No waiting events found dispatching network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:01:56 user nova-compute[74278]: WARNING nova.compute.manager [req-9ed9f130-9fcc-46d1-bcc4-f444b79fd16d req-b0a9000f-cd2b-44b8-8a1a-ceed76133220 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received unexpected event network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 for instance with vm_state building and task_state spawning.
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52d0ddb-0c4a-462a-87bc-46d05d3ed738]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:01:56 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:01:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:01:56 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:01:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e6dccd-378f-4c45-ade0-47564437cc82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22, portal: 172.16.0.220,3260]
Oct 30 11:01:56 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22, portal: 172.16.0.220,3260] successful.
Oct 30 11:01:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de836fd-066f-40d5-83d7-ff6ba9e3f689]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dda148-1528-4aa1-84f1-7c47aa3f55d5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:01:56 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:01:56 user nova-compute[74278]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 (non-flash)
Oct 30 11:01:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:01:56 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:01:56 user nova-compute[74278]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 (non-flash)
Oct 30 11:01:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:01:56 user nova-compute[74278]: INFO nova.compute.manager [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Took 5.81 seconds to spawn the instance on the hypervisor.
Oct 30 11:01:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a814272-2481-4135-bbd8-855d1d01a290]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:01:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRVZpxju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:01:56 user nova-compute[74278]: INFO nova.compute.manager [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Took 6.67 seconds to build instance.
Oct 30 11:01:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-12e5cd68-4cac-4734-b978-ea5cd023e633 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.779s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:01:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26430653434623365', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:01:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430653434623365', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:01:57 user nova-compute[74278]: DEBUG nova.objects.instance [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lazy-loading 'flavor' on Instance uuid 23852f7e-6e4a-4e19-91ff-d9914c04cf83 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:01:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:01:57 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:01:57 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:01:57 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:01:57 user nova-compute[74278]:   <serial>27bd78ea-b688-4697-8050-bc5fdde54b22</serial>
Oct 30 11:01:57 user nova-compute[74278]: </disk>
Oct 30 11:01:57 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:01:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "6d868c1e-1985-48b6-a881-4d17b364701a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:01:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:01:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:01:58 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:01:58 user nova-compute[74278]: INFO nova.compute.claims [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Claim successful on node user
Oct 30 11:01:58 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:01:58 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:01:58 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] No VIF found with MAC fa:16:3e:37:3e:a6, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:01:58 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:01:58 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:01:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-efa09b80-6b65-4586-80ec-d55890a3cadb tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.250s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.760s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:01:58 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:01:58 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:01:58 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:01:58 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:01:58 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:01:59 user nova-compute[74278]: DEBUG nova.policy [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6e338955c2f4d4fae81e9fbf93eff39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f6de366be034e23a4d60302674b76c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:01:59 user nova-compute[74278]: INFO nova.virt.block_device [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Booting with volume-backed-image 4107584d-f654-453b-972a-abcf1c7a0671 at /dev/vda
Oct 30 11:01:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:01:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Successfully created port: 1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:02:00 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Successfully updated port: 1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:02:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "refresh_cache-6d868c1e-1985-48b6-a881-4d17b364701a" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:02:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquired lock "refresh_cache-6d868c1e-1985-48b6-a881-4d17b364701a" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:02:00 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:02:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-345cc82c-90ce-4f6f-a65a-10a6c0b70b7a req-e56f0b7b-dbdb-4ef6-a5bf-642d912476ed service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-changed-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-345cc82c-90ce-4f6f-a65a-10a6c0b70b7a req-e56f0b7b-dbdb-4ef6-a5bf-642d912476ed service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Refreshing instance network info cache due to event network-changed-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:02:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-345cc82c-90ce-4f6f-a65a-10a6c0b70b7a req-e56f0b7b-dbdb-4ef6-a5bf-642d912476ed service nova] Acquiring lock "refresh_cache-6d868c1e-1985-48b6-a881-4d17b364701a" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:02:00 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:02:01 user nova-compute[74278]: DEBUG nova.network.neutron [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Updating instance_info_cache with network_info: [{"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:02:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Releasing lock "refresh_cache-6d868c1e-1985-48b6-a881-4d17b364701a" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:02:01 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Instance network_info: |[{"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:02:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-345cc82c-90ce-4f6f-a65a-10a6c0b70b7a req-e56f0b7b-dbdb-4ef6-a5bf-642d912476ed service nova] Acquired lock "refresh_cache-6d868c1e-1985-48b6-a881-4d17b364701a" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:02:01 user nova-compute[74278]: DEBUG nova.network.neutron [req-345cc82c-90ce-4f6f-a65a-10a6c0b70b7a req-e56f0b7b-dbdb-4ef6-a5bf-642d912476ed service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Refreshing network info cache for port 1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:02:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:01 user nova-compute[74278]: INFO nova.compute.manager [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Detaching volume 27bd78ea-b688-4697-8050-bc5fdde54b22
Oct 30 11:02:01 user nova-compute[74278]: INFO nova.virt.block_device [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Attempting to driver detach volume 27bd78ea-b688-4697-8050-bc5fdde54b22 from mountpoint /dev/vdb
Oct 30 11:02:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Attempting to detach device vdb from instance 23852f7e-6e4a-4e19-91ff-d9914c04cf83 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:02:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:02:01 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:02:01 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:02:01 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:02:01 user nova-compute[74278]:   <serial>27bd78ea-b688-4697-8050-bc5fdde54b22</serial>
Oct 30 11:02:01 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:02:01 user nova-compute[74278]: </disk>
Oct 30 11:02:01 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:02:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Successfully detached device vdb from instance 23852f7e-6e4a-4e19-91ff-d9914c04cf83 from the persistent domain config.
Oct 30 11:02:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 23852f7e-6e4a-4e19-91ff-d9914c04cf83 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:02:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:02:01 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:02:01 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:02:01 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:02:01 user nova-compute[74278]:   <serial>27bd78ea-b688-4697-8050-bc5fdde54b22</serial>
Oct 30 11:02:01 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:02:01 user nova-compute[74278]: </disk>
Oct 30 11:02:01 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:02:01 user nova-compute[74278]: DEBUG nova.network.neutron [req-345cc82c-90ce-4f6f-a65a-10a6c0b70b7a req-e56f0b7b-dbdb-4ef6-a5bf-642d912476ed service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Updated VIF entry in instance network info cache for port 1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:02:01 user nova-compute[74278]: DEBUG nova.network.neutron [req-345cc82c-90ce-4f6f-a65a-10a6c0b70b7a req-e56f0b7b-dbdb-4ef6-a5bf-642d912476ed service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Updating instance_info_cache with network_info: [{"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:02:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-345cc82c-90ce-4f6f-a65a-10a6c0b70b7a req-e56f0b7b-dbdb-4ef6-a5bf-642d912476ed service nova] Releasing lock "refresh_cache-6d868c1e-1985-48b6-a881-4d17b364701a" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:02:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 23852f7e-6e4a-4e19-91ff-d9914c04cf83 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:02:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:02:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG os_brick.utils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.211s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d27a3be-d1d9-47b6-b071-461ee680adc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8054a0b4-26c6-4e3c-9fcd-eee2c7875a4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b0d47d-b076-4bcf-8e25-d616b9c30618]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b752514-315a-4c31-94f3-8740808401f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:02:20 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:02:20 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccaad4c-adb0-4a9b-a0b0-f6ceb3602efb]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG os_brick.utils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] <== get_connector_properties: return (342ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:02:20 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Updating existing volume attachment record: b845a41d-422b-4546-839c-ac9c1e55f314 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:02:22 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 23852f7e-6e4a-4e19-91ff-d9914c04cf83 is timed out.
Oct 30 11:02:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Successfully detached device vdb from instance 23852f7e-6e4a-4e19-91ff-d9914c04cf83 from the live domain config.
Oct 30 11:02:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRVZpxju', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:02:22 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[150eb0f3-7564-4d74-bab6-10eddb6619b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:02:22 user nova-compute[74278]: No targets found.
Oct 30 11:02:22 user nova-compute[74278]: iSNS:
Oct 30 11:02:22 user nova-compute[74278]: No targets found.
Oct 30 11:02:22 user nova-compute[74278]: STATIC:
Oct 30 11:02:22 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:02:22 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:02:22 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:02:22 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22
Oct 30 11:02:22 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:02:22 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:02:22 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce
Oct 30 11:02:22 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:02:22 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:02:22 user nova-compute[74278]: FIRMWARE:
Oct 30 11:02:22 user nova-compute[74278]: No targets found.
Oct 30 11:02:22 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:02:22 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:02:22 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f48e465-b60e-4538-a614-c6d832ed6e29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[33057038-124d-46b2-8cb6-83b9d6aeb624]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:02:22 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:02:22 user nova-compute[74278]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 (non-flash)
Oct 30 11:02:22 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:02:22 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:02:22 user nova-compute[74278]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 (non-flash)
Oct 30 11:02:22 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c209360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4866417f-0703-4208-ae00-3825d05605dd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2f9bf8-5f98-47bc-b365-711a7e5e9d96]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1152c3f-9d29-436a-a8f6-ed84b4f627de]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aae143f-6192-4774-971a-303289b64931]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34712c2-9983-46e8-909e-5f0402dd2d56]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1854a239-9ee6-4b8e-ba84-0bb28c6496e9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22, portal: 172.16.0.220,3260]
Oct 30 11:02:22 user nova-compute[74278]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22, portal: 172.16.0.220,3260] successful.
Oct 30 11:02:22 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27bd78ea-b688-4697-8050-bc5fdde54b22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7e6bfd-5899-499c-b6a7-11e9aaf056e5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] <== disconnect_volume: return (357ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:02:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:23 user nova-compute[74278]: DEBUG nova.objects.instance [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lazy-loading 'flavor' on Instance uuid 23852f7e-6e4a-4e19-91ff-d9914c04cf83 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-98f89fd2-39a2-4e61-aa6e-92529768c803 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.018s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:25 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:02:25 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:02:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:02:26 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:02:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:02:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:02:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:02:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:02:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Updating instance_info_cache with network_info: [{"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:02:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:02:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:02:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:02:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:02:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:02:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:02:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:02:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:02:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:30 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:02:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG nova.objects.instance [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquired lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG nova.network.neutron [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG nova.objects.instance [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'info_cache' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG nova.objects.base [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.network.neutron [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Updating instance_info_cache with network_info: [{"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Releasing lock "refresh_cache-00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:32 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance destroyed successfully.
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.objects.instance [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'resources' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.objects.base [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1903672377',display_name='tempest-AttachVolumeTestJSON-server-1903672377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1903672377',id=14,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw2A/RWC5+R4btriIoM9znu/g01+rQRK1t+3KnEGqXbGVndP3w3zXUjxA1EkRr8FgR+n/Ic2QTQuO6qPRQc5lNQ8uEvxmMbEmYIWKtUXYn+0cTj5aRqBB0fgw9nPXA5Dg==',key_name='tempest-keypair-1025364301',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='928164ecd5c44dddb93fbecfeaa44071',ramdisk_id='',reservation_id='r-o9r3qvit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2116287848',owner_user_name='tempest-AttachVolumeTestJSON-2116287848-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:00:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='525f98e0bed241fdad3962fda627b143',uuid=00dd2fe2-a888-44a1-9dfd-ad72acd03cfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converting VIF {"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG os_vif [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2c68f43-b8, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c39c58e-b2ab-49ca-9125-ca1824511704) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:02:32 user nova-compute[74278]: INFO os_vif [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8')
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Start _get_guest_xml network_info=[{"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.objects.instance [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'numa_topology' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.objects.base [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:02:32 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:02:32 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.objects.instance [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.objects.base [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1903672377',display_name='tempest-AttachVolumeTestJSON-server-1903672377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1903672377',id=14,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw2A/RWC5+R4btriIoM9znu/g01+rQRK1t+3KnEGqXbGVndP3w3zXUjxA1EkRr8FgR+n/Ic2QTQuO6qPRQc5lNQ8uEvxmMbEmYIWKtUXYn+0cTj5aRqBB0fgw9nPXA5Dg==',key_name='tempest-keypair-1025364301',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='928164ecd5c44dddb93fbecfeaa44071',ramdisk_id='',reservation_id='r-o9r3qvit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2116287848',owner_user_name='tempest-AttachVolumeTestJSON-2116287848-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:00:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='525f98e0bed241fdad3962fda627b143',uuid=00dd2fe2-a888-44a1-9dfd-ad72acd03cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converting VIF {"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.objects.instance [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'pci_devices' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.objects.base [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:02:32 user nova-compute[74278]:   <uuid>00dd2fe2-a888-44a1-9dfd-ad72acd03cfa</uuid>
Oct 30 11:02:32 user nova-compute[74278]:   <name>instance-0000000e</name>
Oct 30 11:02:32 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:02:32 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:02:32 user nova-compute[74278]:   <metadata>
Oct 30 11:02:32 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:02:32 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:02:32 user nova-compute[74278]:       <nova:name>tempest-AttachVolumeTestJSON-server-1903672377</nova:name>
Oct 30 11:02:32 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:02:32</nova:creationTime>
Oct 30 11:02:32 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:02:32 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:02:32 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:02:32 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:02:32 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:02:32 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:02:32 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:02:32 user nova-compute[74278]:       <nova:owner>
Oct 30 11:02:32 user nova-compute[74278]:         <nova:user uuid="525f98e0bed241fdad3962fda627b143">tempest-AttachVolumeTestJSON-2116287848-project-member</nova:user>
Oct 30 11:02:32 user nova-compute[74278]:         <nova:project uuid="928164ecd5c44dddb93fbecfeaa44071">tempest-AttachVolumeTestJSON-2116287848</nova:project>
Oct 30 11:02:32 user nova-compute[74278]:       </nova:owner>
Oct 30 11:02:32 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:02:32 user nova-compute[74278]:       <nova:ports>
Oct 30 11:02:32 user nova-compute[74278]:         <nova:port uuid="c2c68f43-b884-4bf0-8948-447c35ce1402">
Oct 30 11:02:32 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 11:02:32 user nova-compute[74278]:         </nova:port>
Oct 30 11:02:32 user nova-compute[74278]:       </nova:ports>
Oct 30 11:02:32 user nova-compute[74278]:     </nova:instance>
Oct 30 11:02:32 user nova-compute[74278]:   </metadata>
Oct 30 11:02:32 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:02:32 user nova-compute[74278]:     <system>
Oct 30 11:02:32 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:02:32 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:02:32 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:02:32 user nova-compute[74278]:       <entry name="serial">00dd2fe2-a888-44a1-9dfd-ad72acd03cfa</entry>
Oct 30 11:02:32 user nova-compute[74278]:       <entry name="uuid">00dd2fe2-a888-44a1-9dfd-ad72acd03cfa</entry>
Oct 30 11:02:32 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:02:32 user nova-compute[74278]:     </system>
Oct 30 11:02:32 user nova-compute[74278]:   </sysinfo>
Oct 30 11:02:32 user nova-compute[74278]:   <os>
Oct 30 11:02:32 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:02:32 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:02:32 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:02:32 user nova-compute[74278]:   </os>
Oct 30 11:02:32 user nova-compute[74278]:   <features>
Oct 30 11:02:32 user nova-compute[74278]:     <acpi/>
Oct 30 11:02:32 user nova-compute[74278]:     <apic/>
Oct 30 11:02:32 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:02:32 user nova-compute[74278]:   </features>
Oct 30 11:02:32 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:02:32 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:02:32 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:02:32 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:02:32 user nova-compute[74278]:   </clock>
Oct 30 11:02:32 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:02:32 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:02:32 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:02:32 user nova-compute[74278]:   </cpu>
Oct 30 11:02:32 user nova-compute[74278]:   <devices>
Oct 30 11:02:32 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:02:32 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:02:32 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk"/>
Oct 30 11:02:32 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:02:32 user nova-compute[74278]:     </disk>
Oct 30 11:02:32 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:02:32 user nova-compute[74278]:       <mac address="fa:16:3e:86:86:a1"/>
Oct 30 11:02:32 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:02:32 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:02:32 user nova-compute[74278]:       <target dev="tapc2c68f43-b8"/>
Oct 30 11:02:32 user nova-compute[74278]:     </interface>
Oct 30 11:02:32 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:02:32 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/console.log" append="off"/>
Oct 30 11:02:32 user nova-compute[74278]:     </serial>
Oct 30 11:02:32 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:02:32 user nova-compute[74278]:     <video>
Oct 30 11:02:32 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:02:32 user nova-compute[74278]:     </video>
Oct 30 11:02:32 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:02:32 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:02:32 user nova-compute[74278]:     </rng>
Oct 30 11:02:32 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:02:32 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:02:32 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:02:32 user nova-compute[74278]:     </memballoon>
Oct 30 11:02:32 user nova-compute[74278]:   </devices>
Oct 30 11:02:32 user nova-compute[74278]: </domain>
Oct 30 11:02:32 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:02:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG nova.objects.instance [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG nova.objects.base [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Cannot resize image /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG nova.objects.instance [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'migration_context' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG nova.objects.base [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Object Instance<00dd2fe2-a888-44a1-9dfd-ad72acd03cfa> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1903672377',display_name='tempest-AttachVolumeTestJSON-server-1903672377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1903672377',id=14,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw2A/RWC5+R4btriIoM9znu/g01+rQRK1t+3KnEGqXbGVndP3w3zXUjxA1EkRr8FgR+n/Ic2QTQuO6qPRQc5lNQ8uEvxmMbEmYIWKtUXYn+0cTj5aRqBB0fgw9nPXA5Dg==',key_name='tempest-keypair-1025364301',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='928164ecd5c44dddb93fbecfeaa44071',ramdisk_id='',reservation_id='r-o9r3qvit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2116287848',owner_user_name='tempest-AttachVolumeTestJSON-2116287848-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:00:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='525f98e0bed241fdad3962fda627b143',uuid=00dd2fe2-a888-44a1-9dfd-ad72acd03cfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converting VIF {"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG os_vif [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8469df57-5f47-51a9-bc7d-b385d03a17bf', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2c68f43-b8, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2c68f43-b8, col_values=(('qos', UUID('5f464292-c5d0-4f3c-9852-f93acf1f8f3a')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2c68f43-b8, col_values=(('external_ids', {'iface-id': 'c2c68f43-b884-4bf0-8948-447c35ce1402', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:86:a1', 'vm-uuid': '00dd2fe2-a888-44a1-9dfd-ad72acd03cfa'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:33 user nova-compute[74278]: INFO os_vif [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8')
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:02:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:35 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:02:35 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7301MB free_disk=24.768436431884766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-fb02e5ac-e3ef-41d9-b605-12bc788fa8ef req-58890b6d-fb54-4a20-a0bd-f966c92eff65 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fb02e5ac-e3ef-41d9-b605-12bc788fa8ef req-58890b6d-fb54-4a20-a0bd-f966c92eff65 service nova] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fb02e5ac-e3ef-41d9-b605-12bc788fa8ef req-58890b6d-fb54-4a20-a0bd-f966c92eff65 service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fb02e5ac-e3ef-41d9-b605-12bc788fa8ef req-58890b6d-fb54-4a20-a0bd-f966c92eff65 service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-fb02e5ac-e3ef-41d9-b605-12bc788fa8ef req-58890b6d-fb54-4a20-a0bd-f966c92eff65 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] No waiting events found dispatching network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:02:35 user nova-compute[74278]: WARNING nova.compute.manager [req-fb02e5ac-e3ef-41d9-b605-12bc788fa8ef req-58890b6d-fb54-4a20-a0bd-f966c92eff65 service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received unexpected event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 for instance with vm_state stopped and task_state powering-on.
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 64287717-7d3b-4087-aedf-faf87be774a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2b8efca4-cec4-4179-99af-92172f9b8a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 23852f7e-6e4a-4e19-91ff-d9914c04cf83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 3d76b06b-9009-4879-83f4-819b1d20ce6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance ef2b0994-a1be-49f5-8617-7fedfeaeca6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 6d868c1e-1985-48b6-a881-4d17b364701a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:35 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:02:36 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:02:36 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:02:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.183s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:37 user nova-compute[74278]: DEBUG nova.compute.manager [req-54981e41-530b-4bc9-a753-6b58a27b095a req-9d67c295-02ee-4bea-b374-6ad5ac1a3bad service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-54981e41-530b-4bc9-a753-6b58a27b095a req-9d67c295-02ee-4bea-b374-6ad5ac1a3bad service nova] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-54981e41-530b-4bc9-a753-6b58a27b095a req-9d67c295-02ee-4bea-b374-6ad5ac1a3bad service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-54981e41-530b-4bc9-a753-6b58a27b095a req-9d67c295-02ee-4bea-b374-6ad5ac1a3bad service nova] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:37 user nova-compute[74278]: DEBUG nova.compute.manager [req-54981e41-530b-4bc9-a753-6b58a27b095a req-9d67c295-02ee-4bea-b374-6ad5ac1a3bad service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] No waiting events found dispatching network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:02:37 user nova-compute[74278]: WARNING nova.compute.manager [req-54981e41-530b-4bc9-a753-6b58a27b095a req-9d67c295-02ee-4bea-b374-6ad5ac1a3bad service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received unexpected event network-vif-plugged-c2c68f43-b884-4bf0-8948-447c35ce1402 for instance with vm_state stopped and task_state powering-on.
Oct 30 11:02:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:02:37 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance rebooted successfully.
Oct 30 11:02:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-49588008-03d7-4210-a56c-17f22385917b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:02:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:39 user nova-compute[74278]: DEBUG nova.compute.manager [req-be4fe393-1c29-4424-a0cb-7585d13774a0 req-bda703ec-9e4c-4dc3-9b32-fdd23f213fac service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-changed-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:39 user nova-compute[74278]: DEBUG nova.compute.manager [req-be4fe393-1c29-4424-a0cb-7585d13774a0 req-bda703ec-9e4c-4dc3-9b32-fdd23f213fac service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Refreshing instance network info cache due to event network-changed-0ca50716-192b-473f-bc5a-d1136a8d52dd. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:02:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-be4fe393-1c29-4424-a0cb-7585d13774a0 req-bda703ec-9e4c-4dc3-9b32-fdd23f213fac service nova] Acquiring lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:02:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-be4fe393-1c29-4424-a0cb-7585d13774a0 req-bda703ec-9e4c-4dc3-9b32-fdd23f213fac service nova] Acquired lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:02:39 user nova-compute[74278]: DEBUG nova.network.neutron [req-be4fe393-1c29-4424-a0cb-7585d13774a0 req-bda703ec-9e4c-4dc3-9b32-fdd23f213fac service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Refreshing network info cache for port 0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:02:39 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:02:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:39 user nova-compute[74278]: DEBUG nova.network.neutron [req-be4fe393-1c29-4424-a0cb-7585d13774a0 req-bda703ec-9e4c-4dc3-9b32-fdd23f213fac service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updated VIF entry in instance network info cache for port 0ca50716-192b-473f-bc5a-d1136a8d52dd. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:02:39 user nova-compute[74278]: DEBUG nova.network.neutron [req-be4fe393-1c29-4424-a0cb-7585d13774a0 req-bda703ec-9e4c-4dc3-9b32-fdd23f213fac service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updating instance_info_cache with network_info: [{"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:02:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-be4fe393-1c29-4424-a0cb-7585d13774a0 req-bda703ec-9e4c-4dc3-9b32-fdd23f213fac service nova] Releasing lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:02:42 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Creating image(s)
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Ensure instance console log exists: /opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Start _get_guest_xml network_info=[{"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCSOnfXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d868c1e-1985-48b6-a881-4d17b364701a', 'attached_at': '', 'detached_at': '', 'volume_id': '4984245f-1520-4324-898f-ab595bc0beb3', 'serial': '4984245f-1520-4324-898f-ab595bc0beb3'}, 'attachment_id': 'b845a41d-422b-4546-839c-ac9c1e55f314', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:02:42 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:02:42 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCSOnfXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:02:42 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:02:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:02:42 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:02:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:02:42 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c676aa3-1710-48b1-b3e2-f59dee88077d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:02:42 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0c9492-0a94-4113-a063-a47468165af3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3] added
Oct 30 11:02:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0897b761-67f4-459e-abac-1457c3a862f3]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ac0da0-19e0-4689-bd16-0a02d56cb0bd]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCSOnfXT {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCSOnfXT" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[61df2b1d-9a52-4bce-b31f-74fc877d2588]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NCSOnfXT'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfc810c-16d7-4dbd-b6be-ca6f258ba1af]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:02:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7ca4e7-078d-4e46-ab84-dece996a3fa0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:02:43 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:02:43 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:02:43 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:02:43 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed1106-1c4a-439d-afc6-d99300f5d161]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3, portal: 172.16.0.220,3260]
Oct 30 11:02:43 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3, portal: 172.16.0.220,3260] successful.
Oct 30 11:02:43 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67033cd-7880-45ba-a68d-871a20059334]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a20ca6-a0c5-4c5b-9a0c-cfca02fab689]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:02:43 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:02:43 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:02:43 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:02:43 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:02:43 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:02:43 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2293c1a7-ed99-4341-a70f-ef68ce68896a]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCSOnfXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Acquiring lock "2b8efca4-cec4-4179-99af-92172f9b8a06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lazy-loading 'flavor' on Instance uuid 2b8efca4-cec4-4179-99af-92172f9b8a06 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Acquiring lock "2b8efca4-cec4-4179-99af-92172f9b8a06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:43 user nova-compute[74278]: INFO nova.compute.manager [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Attaching volume 60bae430-beff-4060-883e-1bf4b323560e to /dev/vdb
Oct 30 11:02:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG os_brick.utils [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd973917-dba0-4c4f-ac52-f0af648defb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1c77e9-fc9b-41ae-ba7e-bd365c96b161]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[53206e19-0a10-499b-b59e-e9ffcd6c15b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb240c60-1bb0-4134-a66b-e34e59daf737]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:02:44 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4055c4ea-f649-4e15-98f5-6c68643b8d46]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG os_brick.utils [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Updating existing volume attachment record: 6113fa1a-e637-49ac-8e2d-c39372a213ff {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23966616337366131', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966616337366131', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-830327174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-830327174',id=29,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-b80tqbwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:01:59Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=6d868c1e-1985-48b6-a881-4d17b364701a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c0e1514-8d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d868c1e-1985-48b6-a881-4d17b364701a {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:02:44 user nova-compute[74278]:   <uuid>6d868c1e-1985-48b6-a881-4d17b364701a</uuid>
Oct 30 11:02:44 user nova-compute[74278]:   <name>instance-0000001d</name>
Oct 30 11:02:44 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:02:44 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:02:44 user nova-compute[74278]:   <metadata>
Oct 30 11:02:44 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:02:44 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:02:44 user nova-compute[74278]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-830327174</nova:name>
Oct 30 11:02:44 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:02:42</nova:creationTime>
Oct 30 11:02:44 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:02:44 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:02:44 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:02:44 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:02:44 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:02:44 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:02:44 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:02:44 user nova-compute[74278]:       <nova:owner>
Oct 30 11:02:44 user nova-compute[74278]:         <nova:user uuid="e6e338955c2f4d4fae81e9fbf93eff39">tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member</nova:user>
Oct 30 11:02:44 user nova-compute[74278]:         <nova:project uuid="0f6de366be034e23a4d60302674b76c9">tempest-ServerBootFromVolumeStableRescueTest-1058902108</nova:project>
Oct 30 11:02:44 user nova-compute[74278]:       </nova:owner>
Oct 30 11:02:44 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:02:44 user nova-compute[74278]:       <nova:ports>
Oct 30 11:02:44 user nova-compute[74278]:         <nova:port uuid="1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b">
Oct 30 11:02:44 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 11:02:44 user nova-compute[74278]:         </nova:port>
Oct 30 11:02:44 user nova-compute[74278]:       </nova:ports>
Oct 30 11:02:44 user nova-compute[74278]:     </nova:instance>
Oct 30 11:02:44 user nova-compute[74278]:   </metadata>
Oct 30 11:02:44 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:02:44 user nova-compute[74278]:     <system>
Oct 30 11:02:44 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:02:44 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:02:44 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:02:44 user nova-compute[74278]:       <entry name="serial">6d868c1e-1985-48b6-a881-4d17b364701a</entry>
Oct 30 11:02:44 user nova-compute[74278]:       <entry name="uuid">6d868c1e-1985-48b6-a881-4d17b364701a</entry>
Oct 30 11:02:44 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:02:44 user nova-compute[74278]:     </system>
Oct 30 11:02:44 user nova-compute[74278]:   </sysinfo>
Oct 30 11:02:44 user nova-compute[74278]:   <os>
Oct 30 11:02:44 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:02:44 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:02:44 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:02:44 user nova-compute[74278]:   </os>
Oct 30 11:02:44 user nova-compute[74278]:   <features>
Oct 30 11:02:44 user nova-compute[74278]:     <acpi/>
Oct 30 11:02:44 user nova-compute[74278]:     <apic/>
Oct 30 11:02:44 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:02:44 user nova-compute[74278]:   </features>
Oct 30 11:02:44 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:02:44 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:02:44 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:02:44 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:02:44 user nova-compute[74278]:   </clock>
Oct 30 11:02:44 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:02:44 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:02:44 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:02:44 user nova-compute[74278]:   </cpu>
Oct 30 11:02:44 user nova-compute[74278]:   <devices>
Oct 30 11:02:44 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:02:44 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:02:44 user nova-compute[74278]:       <source dev="/dev/sdc"/>
Oct 30 11:02:44 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:02:44 user nova-compute[74278]:       <serial>4984245f-1520-4324-898f-ab595bc0beb3</serial>
Oct 30 11:02:44 user nova-compute[74278]:     </disk>
Oct 30 11:02:44 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:02:44 user nova-compute[74278]:       <mac address="fa:16:3e:64:13:1b"/>
Oct 30 11:02:44 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:02:44 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:02:44 user nova-compute[74278]:       <target dev="tap1c0e1514-8d"/>
Oct 30 11:02:44 user nova-compute[74278]:     </interface>
Oct 30 11:02:44 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:02:44 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/console.log" append="off"/>
Oct 30 11:02:44 user nova-compute[74278]:     </serial>
Oct 30 11:02:44 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:02:44 user nova-compute[74278]:     <video>
Oct 30 11:02:44 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:02:44 user nova-compute[74278]:     </video>
Oct 30 11:02:44 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:02:44 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:02:44 user nova-compute[74278]:     </rng>
Oct 30 11:02:44 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:02:44 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:02:44 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:02:44 user nova-compute[74278]:     </memballoon>
Oct 30 11:02:44 user nova-compute[74278]:   </devices>
Oct 30 11:02:44 user nova-compute[74278]: </domain>
Oct 30 11:02:44 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-830327174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-830327174',id=29,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-b80tqbwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:01:59Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=6d868c1e-1985-48b6-a881-4d17b364701a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c0e1514-8d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG os_vif [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c0e1514-8d') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '047eff11-c0f1-524c-a236-31accf350bd3', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c0e1514-8d, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c0e1514-8d, col_values=(('qos', UUID('a32b4753-d303-44e2-aa78-ccf83af6d65b')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c0e1514-8d, col_values=(('external_ids', {'iface-id': '1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:13:1b', 'vm-uuid': '6d868c1e-1985-48b6-a881-4d17b364701a'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:44 user nova-compute[74278]: INFO os_vif [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c0e1514-8d')
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No VIF found with MAC fa:16:3e:64:13:1b, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ebe4850-5b9e-4fc6-9b16-d1067fd13e76 req-f5924cae-fa1a-4c8a-a05a-282ca51badfe service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Received event network-changed-61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-8ebe4850-5b9e-4fc6-9b16-d1067fd13e76 req-f5924cae-fa1a-4c8a-a05a-282ca51badfe service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Refreshing instance network info cache due to event network-changed-61fae496-e8ce-41d0-99e9-f718e37e8ff6. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ebe4850-5b9e-4fc6-9b16-d1067fd13e76 req-f5924cae-fa1a-4c8a-a05a-282ca51badfe service nova] Acquiring lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ebe4850-5b9e-4fc6-9b16-d1067fd13e76 req-f5924cae-fa1a-4c8a-a05a-282ca51badfe service nova] Acquired lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-8ebe4850-5b9e-4fc6-9b16-d1067fd13e76 req-f5924cae-fa1a-4c8a-a05a-282ca51badfe service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Refreshing network info cache for port 61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:44 user nova-compute[74278]: INFO nova.compute.manager [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Terminating instance
Oct 30 11:02:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG nova.network.neutron [req-8ebe4850-5b9e-4fc6-9b16-d1067fd13e76 req-f5924cae-fa1a-4c8a-a05a-282ca51badfe service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Updated VIF entry in instance network info cache for port 61fae496-e8ce-41d0-99e9-f718e37e8ff6. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG nova.network.neutron [req-8ebe4850-5b9e-4fc6-9b16-d1067fd13e76 req-f5924cae-fa1a-4c8a-a05a-282ca51badfe service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Updating instance_info_cache with network_info: [{"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8ebe4850-5b9e-4fc6-9b16-d1067fd13e76 req-f5924cae-fa1a-4c8a-a05a-282ca51badfe service nova] Releasing lock "refresh_cache-9cba7c39-a2d1-44c0-a866-01c22a3f3634" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG nova.compute.manager [req-e18c1b7a-0d86-40ae-9031-1c5b3b86f866 req-43ec3ae8-1f62-43ec-badc-27dfb7c00bbd service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Received event network-vif-unplugged-61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e18c1b7a-0d86-40ae-9031-1c5b3b86f866 req-43ec3ae8-1f62-43ec-badc-27dfb7c00bbd service nova] Acquiring lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e18c1b7a-0d86-40ae-9031-1c5b3b86f866 req-43ec3ae8-1f62-43ec-badc-27dfb7c00bbd service nova] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e18c1b7a-0d86-40ae-9031-1c5b3b86f866 req-43ec3ae8-1f62-43ec-badc-27dfb7c00bbd service nova] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG nova.compute.manager [req-e18c1b7a-0d86-40ae-9031-1c5b3b86f866 req-43ec3ae8-1f62-43ec-badc-27dfb7c00bbd service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] No waiting events found dispatching network-vif-unplugged-61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:02:45 user nova-compute[74278]: DEBUG nova.compute.manager [req-e18c1b7a-0d86-40ae-9031-1c5b3b86f866 req-43ec3ae8-1f62-43ec-badc-27dfb7c00bbd service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Received event network-vif-unplugged-61fae496-e8ce-41d0-99e9-f718e37e8ff6 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:46 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Instance destroyed successfully.
Oct 30 11:02:46 user nova-compute[74278]: DEBUG nova.objects.instance [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lazy-loading 'resources' on Instance uuid 9cba7c39-a2d1-44c0-a866-01c22a3f3634 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:54:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1141231956',display_name='tempest-TestStampPattern-server-1141231956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1141231956',id=15,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErJIPGly6W6lNejwEf8DtSNy5OrG6xfE/nDhPvCgU8od+RfEYPhZ5Qc+GqAO9q9/7KpAJWL/Kivlo794MTyR38r0U10CkXp6EajAwqkYjjkVym0Mb+QFcYi/6SagifxZw==',key_name='tempest-TestStampPattern-1979010860',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:54:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ba4eff185f543aa8c590fe74f59c7b8',ramdisk_id='',reservation_id='r-706gquao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1462524641',owner_user_name='tempest-TestStampPattern-1462524641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:58:18Z,user_data=None,user_id='0c4560d0bf034d30a8d8d6fac7d347f8',uuid=9cba7c39-a2d1-44c0-a866-01c22a3f3634,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Converting VIF {"id": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "address": "fa:16:3e:0d:b7:d3", "network": {"id": "df739151-346c-47a9-8d9e-0cd95b75c8b9", "bridge": "br-int", "label": "tempest-TestStampPattern-2130890477-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ba4eff185f543aa8c590fe74f59c7b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61fae496-e8", "ovs_interfaceid": "61fae496-e8ce-41d0-99e9-f718e37e8ff6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:b7:d3,bridge_name='br-int',has_traffic_filtering=True,id=61fae496-e8ce-41d0-99e9-f718e37e8ff6,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fae496-e8') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG os_vif [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:b7:d3,bridge_name='br-int',has_traffic_filtering=True,id=61fae496-e8ce-41d0-99e9-f718e37e8ff6,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fae496-e8') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61fae496-e8, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1af4024-7153-4b8f-9a96-f34dba1e2f3c) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:46 user nova-compute[74278]: INFO os_vif [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:b7:d3,bridge_name='br-int',has_traffic_filtering=True,id=61fae496-e8ce-41d0-99e9-f718e37e8ff6,network=Network(df739151-346c-47a9-8d9e-0cd95b75c8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61fae496-e8')
Oct 30 11:02:46 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Deleting instance files /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634_del
Oct 30 11:02:46 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Deletion of /opt/stack/data/nova/instances/9cba7c39-a2d1-44c0-a866-01c22a3f3634_del complete
Oct 30 11:02:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:46 user nova-compute[74278]: INFO nova.compute.manager [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Took 2.00 seconds to destroy the instance on the hypervisor.
Oct 30 11:02:46 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:02:46 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Received event network-vif-plugged-61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] Acquiring lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] No waiting events found dispatching network-vif-plugged-61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:02:47 user nova-compute[74278]: WARNING nova.compute.manager [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Received unexpected event network-vif-plugged-61fae496-e8ce-41d0-99e9-f718e37e8ff6 for instance with vm_state active and task_state deleting.
Oct 30 11:02:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] No waiting events found dispatching network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:02:47 user nova-compute[74278]: WARNING nova.compute.manager [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received unexpected event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b for instance with vm_state building and task_state spawning.
Oct 30 11:02:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] No waiting events found dispatching network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:02:47 user nova-compute[74278]: WARNING nova.compute.manager [req-a8c360bf-a05c-46ba-a9d7-cf1f1f52c8da req-0a420eba-3b85-4f32-8dca-494d6232c00e service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received unexpected event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b for instance with vm_state building and task_state spawning.
Oct 30 11:02:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:47 user nova-compute[74278]: INFO nova.compute.manager [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Shelving
Oct 30 11:02:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:02:48 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Took 1.16 seconds to deallocate network for instance.
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-f3331c5b-1fc8-431c-a99d-f1805e46ae67 req-9e1b5de1-5e02-4939-80a5-5d3fce693e82 service nova] [instance: 9cba7c39-a2d1-44c0-a866-01c22a3f3634] Received event network-vif-deleted-61fae496-e8ce-41d0-99e9-f718e37e8ff6 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Instance destroyed successfully.
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.641s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Beginning cold snapshot process
Oct 30 11:02:48 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Deleted allocations for instance 9cba7c39-a2d1-44c0-a866-01c22a3f3634
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:02:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Instance spawned successfully.
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:02:48 user nova-compute[74278]: INFO nova.compute.manager [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Took 6.27 seconds to spawn the instance on the hypervisor.
Oct 30 11:02:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af7819c2-40a2-44d9-a5eb-b12f0ffb2caa tempest-TestStampPattern-1462524641 tempest-TestStampPattern-1462524641-project-member] Lock "9cba7c39-a2d1-44c0-a866-01c22a3f3634" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.076s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk /opt/stack/data/nova/instances/snapshots/tmpyxaemhi7/812a6387f1494102a1aee6d9b59b24bc {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:49 user nova-compute[74278]: INFO nova.compute.manager [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Took 51.06 seconds to build instance.
Oct 30 11:02:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1489e0fe-488c-47b0-88b6-86214a1dff6a tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "6d868c1e-1985-48b6-a881-4d17b364701a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.196s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-b7de7f46-fa41-4861-93f7-1c0005401a14 req-8704505b-81d5-4788-83b6-4667ef9b75c1 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-vif-unplugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b7de7f46-fa41-4861-93f7-1c0005401a14 req-8704505b-81d5-4788-83b6-4667ef9b75c1 service nova] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b7de7f46-fa41-4861-93f7-1c0005401a14 req-8704505b-81d5-4788-83b6-4667ef9b75c1 service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b7de7f46-fa41-4861-93f7-1c0005401a14 req-8704505b-81d5-4788-83b6-4667ef9b75c1 service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-b7de7f46-fa41-4861-93f7-1c0005401a14 req-8704505b-81d5-4788-83b6-4667ef9b75c1 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] No waiting events found dispatching network-vif-unplugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:02:49 user nova-compute[74278]: WARNING nova.compute.manager [req-b7de7f46-fa41-4861-93f7-1c0005401a14 req-8704505b-81d5-4788-83b6-4667ef9b75c1 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received unexpected event network-vif-unplugged-0ca50716-192b-473f-bc5a-d1136a8d52dd for instance with vm_state active and task_state shelving_image_pending_upload.
Oct 30 11:02:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-b7de7f46-fa41-4861-93f7-1c0005401a14 req-8704505b-81d5-4788-83b6-4667ef9b75c1 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b7de7f46-fa41-4861-93f7-1c0005401a14 req-8704505b-81d5-4788-83b6-4667ef9b75c1 service nova] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b7de7f46-fa41-4861-93f7-1c0005401a14 req-8704505b-81d5-4788-83b6-4667ef9b75c1 service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b7de7f46-fa41-4861-93f7-1c0005401a14 req-8704505b-81d5-4788-83b6-4667ef9b75c1 service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-b7de7f46-fa41-4861-93f7-1c0005401a14 req-8704505b-81d5-4788-83b6-4667ef9b75c1 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] No waiting events found dispatching network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:02:49 user nova-compute[74278]: WARNING nova.compute.manager [req-b7de7f46-fa41-4861-93f7-1c0005401a14 req-8704505b-81d5-4788-83b6-4667ef9b75c1 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received unexpected event network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd for instance with vm_state active and task_state shelving_image_pending_upload.
Oct 30 11:02:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk /opt/stack/data/nova/instances/snapshots/tmpyxaemhi7/812a6387f1494102a1aee6d9b59b24bc" returned: 0 in 1.147s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:50 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Snapshot extracted, beginning image upload
Oct 30 11:02:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:53 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Snapshot image upload complete
Oct 30 11:02:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:02:53 user nova-compute[74278]: INFO nova.compute.manager [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Shelve offloading
Oct 30 11:02:53 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Instance destroyed successfully.
Oct 30 11:02:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:02:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:02:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquired lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:02:53 user nova-compute[74278]: DEBUG nova.network.neutron [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:02:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updating instance_info_cache with network_info: [{"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:02:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Releasing lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:02:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "283358a3-e52d-4019-8d88-8f86d456122f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "283358a3-e52d-4019-8d88-8f86d456122f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:02:55 user nova-compute[74278]: INFO nova.compute.claims [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Claim successful on node user
Oct 30 11:02:55 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Instance destroyed successfully.
Oct 30 11:02:55 user nova-compute[74278]: DEBUG nova.objects.instance [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'resources' on Instance uuid 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1355088922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1355088922',id=25,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfQ76Zf86y/rjX/IZezKroDYRlFxXL4tU5bjyfpE8hTO7Xt3y63g6U10DcW7GCutVK3ORDNhBNel2yoFanFAo9wPHbUl8cHjyHqp+8+3mQyx7QRSBig2itKO+0OYjDbew==',key_name='tempest-keypair-344221549',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:00:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='31dd01e2d9be4a0b96e94493f8eb43d7',ramdisk_id='',reservation_id='r-y1dpjo0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2142703659',owner_user_name='tempest-AttachVolumeShelveTestJSON-2142703659-project-member',shelved_at='2023-10-30T11:02:53.835836',shelved_host='user',shelved_image_id='a668b9fb-576d-47ad-a940-ceaccf81af56'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584de218cec24240a91845deca515efa',uuid=5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converting VIF {"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG os_vif [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-c37fcdbd-c998-457c-82cd-ed525f32dc4c req-bfb385fc-39e6-45e8-b745-bee38a1e89f0 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-changed-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-c37fcdbd-c998-457c-82cd-ed525f32dc4c req-bfb385fc-39e6-45e8-b745-bee38a1e89f0 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Refreshing instance network info cache due to event network-changed-0ca50716-192b-473f-bc5a-d1136a8d52dd. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c37fcdbd-c998-457c-82cd-ed525f32dc4c req-bfb385fc-39e6-45e8-b745-bee38a1e89f0 service nova] Acquiring lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c37fcdbd-c998-457c-82cd-ed525f32dc4c req-bfb385fc-39e6-45e8-b745-bee38a1e89f0 service nova] Acquired lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-c37fcdbd-c998-457c-82cd-ed525f32dc4c req-bfb385fc-39e6-45e8-b745-bee38a1e89f0 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Refreshing network info cache for port 0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ca50716-19, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b2c14dc-2be1-48da-b576-861ec5b5db37) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:02:55 user nova-compute[74278]: INFO os_vif [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19')
Oct 30 11:02:55 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Deleting instance files /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3_del
Oct 30 11:02:55 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Deletion of /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3_del complete
Oct 30 11:02:55 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Deleted allocations for instance 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3
Oct 30 11:02:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:02:55 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.868s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.143s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.objects.instance [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'numa_topology' on Instance uuid 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.objects.base [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Object Instance<5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3> lazy-loaded attributes: resources,numa_topology {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:02:56 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-c37fcdbd-c998-457c-82cd-ed525f32dc4c req-bfb385fc-39e6-45e8-b745-bee38a1e89f0 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updated VIF entry in instance network info cache for port 0ca50716-192b-473f-bc5a-d1136a8d52dd. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-c37fcdbd-c998-457c-82cd-ed525f32dc4c req-bfb385fc-39e6-45e8-b745-bee38a1e89f0 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updating instance_info_cache with network_info: [{"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0ca50716-19", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c37fcdbd-c998-457c-82cd-ed525f32dc4c req-bfb385fc-39e6-45e8-b745-bee38a1e89f0 service nova] Releasing lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.policy [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a8ce768d96b4d42ae87c9e3af6c4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516f9ae7cc1453db5bea067d108eed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:02:56 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Creating image(s)
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "/opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "/opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "/opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.244s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.696s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-74efa7fe-c912-4a1b-8921-369662fae2cc tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.015s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.246s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk 1073741824" returned: 0 in 0.103s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.230s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:57 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Checking if we can resize image /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:02:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:02:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:02:57 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Cannot resize image /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:02:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:02:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Ensure instance console log exists: /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:02:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-7a0482bf-6a54-4892-b5e2-c69a84c164f4 req-d986d239-7431-4bac-b4c7-f706e01ef4b9 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event network-changed-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-7a0482bf-6a54-4892-b5e2-c69a84c164f4 req-d986d239-7431-4bac-b4c7-f706e01ef4b9 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Refreshing instance network info cache due to event network-changed-8fac0256-08e9-4391-9b63-41b420e15539. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7a0482bf-6a54-4892-b5e2-c69a84c164f4 req-d986d239-7431-4bac-b4c7-f706e01ef4b9 service nova] Acquiring lock "refresh_cache-3d76b06b-9009-4879-83f4-819b1d20ce6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7a0482bf-6a54-4892-b5e2-c69a84c164f4 req-d986d239-7431-4bac-b4c7-f706e01ef4b9 service nova] Acquired lock "refresh_cache-3d76b06b-9009-4879-83f4-819b1d20ce6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG nova.network.neutron [req-7a0482bf-6a54-4892-b5e2-c69a84c164f4 req-d986d239-7431-4bac-b4c7-f706e01ef4b9 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Refreshing network info cache for port 8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Successfully created port: 7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG nova.network.neutron [req-7a0482bf-6a54-4892-b5e2-c69a84c164f4 req-d986d239-7431-4bac-b4c7-f706e01ef4b9 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Updated VIF entry in instance network info cache for port 8fac0256-08e9-4391-9b63-41b420e15539. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG nova.network.neutron [req-7a0482bf-6a54-4892-b5e2-c69a84c164f4 req-d986d239-7431-4bac-b4c7-f706e01ef4b9 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Updating instance_info_cache with network_info: [{"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7a0482bf-6a54-4892-b5e2-c69a84c164f4 req-d986d239-7431-4bac-b4c7-f706e01ef4b9 service nova] Releasing lock "refresh_cache-3d76b06b-9009-4879-83f4-819b1d20ce6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Successfully updated port: 7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "refresh_cache-283358a3-e52d-4019-8d88-8f86d456122f" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquired lock "refresh_cache-283358a3-e52d-4019-8d88-8f86d456122f" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:02:58 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:02:59 user nova-compute[74278]: INFO nova.compute.manager [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Rebuilding instance
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Updating instance_info_cache with network_info: [{"id": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "address": "fa:16:3e:6a:3b:7a", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef4ca6a-60", "ovs_interfaceid": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Releasing lock "refresh_cache-283358a3-e52d-4019-8d88-8f86d456122f" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Instance network_info: |[{"id": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "address": "fa:16:3e:6a:3b:7a", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef4ca6a-60", "ovs_interfaceid": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Start _get_guest_xml network_info=[{"id": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "address": "fa:16:3e:6a:3b:7a", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef4ca6a-60", "ovs_interfaceid": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:02:59 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:02:59 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1104859434',display_name='tempest-VolumesActionsTest-instance-1104859434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1104859434',id=30,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6516f9ae7cc1453db5bea067d108eed1',ramdisk_id='',reservation_id='r-wk8x9q36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1938085894',owner_user_name='tempest-VolumesActionsTest-1938085894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:02:56Z,user_data=None,user_id='2a8ce768d96b4d42ae87c9e3af6c4592',uuid=283358a3-e52d-4019-8d88-8f86d456122f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "address": "fa:16:3e:6a:3b:7a", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef4ca6a-60", "ovs_interfaceid": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Converting VIF {"id": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "address": "fa:16:3e:6a:3b:7a", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef4ca6a-60", "ovs_interfaceid": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3b:7a,bridge_name='br-int',has_traffic_filtering=True,id=7ef4ca6a-60b8-42a8-b439-85ff898b9c79,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef4ca6a-60') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.objects.instance [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lazy-loading 'pci_devices' on Instance uuid 283358a3-e52d-4019-8d88-8f86d456122f {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:02:59 user nova-compute[74278]:   <uuid>283358a3-e52d-4019-8d88-8f86d456122f</uuid>
Oct 30 11:02:59 user nova-compute[74278]:   <name>instance-0000001e</name>
Oct 30 11:02:59 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:02:59 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:02:59 user nova-compute[74278]:   <metadata>
Oct 30 11:02:59 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:02:59 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:02:59 user nova-compute[74278]:       <nova:name>tempest-VolumesActionsTest-instance-1104859434</nova:name>
Oct 30 11:02:59 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:02:59</nova:creationTime>
Oct 30 11:02:59 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:02:59 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:02:59 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:02:59 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:02:59 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:02:59 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:02:59 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:02:59 user nova-compute[74278]:       <nova:owner>
Oct 30 11:02:59 user nova-compute[74278]:         <nova:user uuid="2a8ce768d96b4d42ae87c9e3af6c4592">tempest-VolumesActionsTest-1938085894-project-member</nova:user>
Oct 30 11:02:59 user nova-compute[74278]:         <nova:project uuid="6516f9ae7cc1453db5bea067d108eed1">tempest-VolumesActionsTest-1938085894</nova:project>
Oct 30 11:02:59 user nova-compute[74278]:       </nova:owner>
Oct 30 11:02:59 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:02:59 user nova-compute[74278]:       <nova:ports>
Oct 30 11:02:59 user nova-compute[74278]:         <nova:port uuid="7ef4ca6a-60b8-42a8-b439-85ff898b9c79">
Oct 30 11:02:59 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 11:02:59 user nova-compute[74278]:         </nova:port>
Oct 30 11:02:59 user nova-compute[74278]:       </nova:ports>
Oct 30 11:02:59 user nova-compute[74278]:     </nova:instance>
Oct 30 11:02:59 user nova-compute[74278]:   </metadata>
Oct 30 11:02:59 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:02:59 user nova-compute[74278]:     <system>
Oct 30 11:02:59 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:02:59 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:02:59 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:02:59 user nova-compute[74278]:       <entry name="serial">283358a3-e52d-4019-8d88-8f86d456122f</entry>
Oct 30 11:02:59 user nova-compute[74278]:       <entry name="uuid">283358a3-e52d-4019-8d88-8f86d456122f</entry>
Oct 30 11:02:59 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:02:59 user nova-compute[74278]:     </system>
Oct 30 11:02:59 user nova-compute[74278]:   </sysinfo>
Oct 30 11:02:59 user nova-compute[74278]:   <os>
Oct 30 11:02:59 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:02:59 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:02:59 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:02:59 user nova-compute[74278]:   </os>
Oct 30 11:02:59 user nova-compute[74278]:   <features>
Oct 30 11:02:59 user nova-compute[74278]:     <acpi/>
Oct 30 11:02:59 user nova-compute[74278]:     <apic/>
Oct 30 11:02:59 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:02:59 user nova-compute[74278]:   </features>
Oct 30 11:02:59 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:02:59 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:02:59 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:02:59 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:02:59 user nova-compute[74278]:   </clock>
Oct 30 11:02:59 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:02:59 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:02:59 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:02:59 user nova-compute[74278]:   </cpu>
Oct 30 11:02:59 user nova-compute[74278]:   <devices>
Oct 30 11:02:59 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:02:59 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:02:59 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk"/>
Oct 30 11:02:59 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:02:59 user nova-compute[74278]:     </disk>
Oct 30 11:02:59 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:02:59 user nova-compute[74278]:       <mac address="fa:16:3e:6a:3b:7a"/>
Oct 30 11:02:59 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:02:59 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:02:59 user nova-compute[74278]:       <target dev="tap7ef4ca6a-60"/>
Oct 30 11:02:59 user nova-compute[74278]:     </interface>
Oct 30 11:02:59 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:02:59 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/console.log" append="off"/>
Oct 30 11:02:59 user nova-compute[74278]:     </serial>
Oct 30 11:02:59 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:02:59 user nova-compute[74278]:     <video>
Oct 30 11:02:59 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:02:59 user nova-compute[74278]:     </video>
Oct 30 11:02:59 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:02:59 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:02:59 user nova-compute[74278]:     </rng>
Oct 30 11:02:59 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:02:59 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:02:59 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:02:59 user nova-compute[74278]:     </memballoon>
Oct 30 11:02:59 user nova-compute[74278]:   </devices>
Oct 30 11:02:59 user nova-compute[74278]: </domain>
Oct 30 11:02:59 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1104859434',display_name='tempest-VolumesActionsTest-instance-1104859434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1104859434',id=30,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6516f9ae7cc1453db5bea067d108eed1',ramdisk_id='',reservation_id='r-wk8x9q36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1938085894',owner_user_name='tempest-VolumesActionsTest-1938085894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:02:56Z,user_data=None,user_id='2a8ce768d96b4d42ae87c9e3af6c4592',uuid=283358a3-e52d-4019-8d88-8f86d456122f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "address": "fa:16:3e:6a:3b:7a", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef4ca6a-60", "ovs_interfaceid": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Converting VIF {"id": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "address": "fa:16:3e:6a:3b:7a", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef4ca6a-60", "ovs_interfaceid": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3b:7a,bridge_name='br-int',has_traffic_filtering=True,id=7ef4ca6a-60b8-42a8-b439-85ff898b9c79,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef4ca6a-60') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG os_vif [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3b:7a,bridge_name='br-int',has_traffic_filtering=True,id=7ef4ca6a-60b8-42a8-b439-85ff898b9c79,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef4ca6a-60') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6019bef2-0c68-568c-9cf5-45616c42e21a', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ef4ca6a-60, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ef4ca6a-60, col_values=(('qos', UUID('25ca2591-d96f-4598-9c5d-650f8c89fd73')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ef4ca6a-60, col_values=(('external_ids', {'iface-id': '7ef4ca6a-60b8-42a8-b439-85ff898b9c79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:3b:7a', 'vm-uuid': '283358a3-e52d-4019-8d88-8f86d456122f'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:02:59 user nova-compute[74278]: INFO os_vif [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3b:7a,bridge_name='br-int',has_traffic_filtering=True,id=7ef4ca6a-60b8-42a8-b439-85ff898b9c79,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef4ca6a-60')
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] No VIF found with MAC fa:16:3e:6a:3b:7a, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-c574055d-c0a9-41f7-89be-b0b8b4c3b9b6 req-622a0506-5069-4292-a85e-8344098411da service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event network-vif-unplugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c574055d-c0a9-41f7-89be-b0b8b4c3b9b6 req-622a0506-5069-4292-a85e-8344098411da service nova] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c574055d-c0a9-41f7-89be-b0b8b4c3b9b6 req-622a0506-5069-4292-a85e-8344098411da service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c574055d-c0a9-41f7-89be-b0b8b4c3b9b6 req-622a0506-5069-4292-a85e-8344098411da service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:02:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-c574055d-c0a9-41f7-89be-b0b8b4c3b9b6 req-622a0506-5069-4292-a85e-8344098411da service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] No waiting events found dispatching network-vif-unplugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:02:59 user nova-compute[74278]: WARNING nova.compute.manager [req-c574055d-c0a9-41f7-89be-b0b8b4c3b9b6 req-622a0506-5069-4292-a85e-8344098411da service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received unexpected event network-vif-unplugged-8fac0256-08e9-4391-9b63-41b420e15539 for instance with vm_state active and task_state rebuilding.
Oct 30 11:03:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-b833bccf-a799-47e3-b7bd-854d5387281b req-12caa072-8b30-40f8-9d5f-178b41a7a82a service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Received event network-changed-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-b833bccf-a799-47e3-b7bd-854d5387281b req-12caa072-8b30-40f8-9d5f-178b41a7a82a service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Refreshing instance network info cache due to event network-changed-7ef4ca6a-60b8-42a8-b439-85ff898b9c79. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:03:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b833bccf-a799-47e3-b7bd-854d5387281b req-12caa072-8b30-40f8-9d5f-178b41a7a82a service nova] Acquiring lock "refresh_cache-283358a3-e52d-4019-8d88-8f86d456122f" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:03:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b833bccf-a799-47e3-b7bd-854d5387281b req-12caa072-8b30-40f8-9d5f-178b41a7a82a service nova] Acquired lock "refresh_cache-283358a3-e52d-4019-8d88-8f86d456122f" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:03:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-b833bccf-a799-47e3-b7bd-854d5387281b req-12caa072-8b30-40f8-9d5f-178b41a7a82a service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Refreshing network info cache for port 7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:03:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-b833bccf-a799-47e3-b7bd-854d5387281b req-12caa072-8b30-40f8-9d5f-178b41a7a82a service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Updated VIF entry in instance network info cache for port 7ef4ca6a-60b8-42a8-b439-85ff898b9c79. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:03:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-b833bccf-a799-47e3-b7bd-854d5387281b req-12caa072-8b30-40f8-9d5f-178b41a7a82a service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Updating instance_info_cache with network_info: [{"id": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "address": "fa:16:3e:6a:3b:7a", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef4ca6a-60", "ovs_interfaceid": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:03:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b833bccf-a799-47e3-b7bd-854d5387281b req-12caa072-8b30-40f8-9d5f-178b41a7a82a service nova] Releasing lock "refresh_cache-283358a3-e52d-4019-8d88-8f86d456122f" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:03:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Instance destroyed successfully.
Oct 30 11:03:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Instance destroyed successfully.
Oct 30 11:03:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-248564876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1641223937',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHVmrqblopLInY1Wvk20+mn5oY9HK3qJoDsTdzD86gNKR60O24Sw37vqqe1SrB61PQcGQ4FQ4hLz1IfnqJniiFuJlMlaNcPIwOFFcbpXS/Op3g50/gRu7VGHSf0Wg5YEw==',key_name='tempest-keypair-1295466818',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0e2c85eda9534f06bd5d7db1300d1f73',ramdisk_id='',reservation_id='r-mt0ozl4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-632878584',owner_user_name='tempest-ServerActionsV293TestJSON-632878584-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e7bb5f85c254f3d9febe9dc037a8459',uuid=3d76b06b-9009-4879-83f4-819b1d20ce6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Converting VIF {"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_vif [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fac0256-08, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50b5b126-3364-42d4-be45-5d2f37e4af7e) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:01 user nova-compute[74278]: INFO os_vif [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08')
Oct 30 11:03:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWlZnusY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:03:01 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc9716d-cf8a-44a9-a4b4-98729bc3705d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:03:01 user nova-compute[74278]: No targets found.
Oct 30 11:03:01 user nova-compute[74278]: iSNS:
Oct 30 11:03:01 user nova-compute[74278]: No targets found.
Oct 30 11:03:01 user nova-compute[74278]: STATIC:
Oct 30 11:03:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3
Oct 30 11:03:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:03:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:03:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:03:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:03:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:03:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce
Oct 30 11:03:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:03:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:03:01 user nova-compute[74278]: FIRMWARE:
Oct 30 11:03:01 user nova-compute[74278]: No targets found.
Oct 30 11:03:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:03:01 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:03:01 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c46813-9661-47d3-b6f1-5b376d1ebd2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1236c37-87dc-4015-90d2-b6d047ee2dee]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:01 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:03:01 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:01 user nova-compute[74278]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:03:01 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac139ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.049s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8a7b1e-dff1-4323-8d63-730f62e71280]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.034s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[977dfeba-7629-4f60-8667-8f1672fe294b]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bf1178-c226-43af-8f9f-1ec065f93b5e]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ccd121-f79a-4bcc-88de-33c5b4c1f634]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ea85d1-b813-4226-ad8c-8f31f8a9ccce]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[608f8320-2f53-46f0-bc14-bfa8edef602c]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260]
Oct 30 11:03:01 user nova-compute[74278]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260] successful.
Oct 30 11:03:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cb2aa8-02c5-4e51-87ee-56b4bf3b67fd]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] <== disconnect_volume: return (451ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:03:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:03:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Deleting instance files /opt/stack/data/nova/instances/3d76b06b-9009-4879-83f4-819b1d20ce6c_del
Oct 30 11:03:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Deletion of /opt/stack/data/nova/instances/3d76b06b-9009-4879-83f4-819b1d20ce6c_del complete
Oct 30 11:03:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:02 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 3d76b06b-9009-4879-83f4-819b1d20ce6c could not be found.
Oct 30 11:03:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWlZnusY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:03:02 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 11:03:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5232b5f-b942-4345-a335-407de7f55b45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:03:02 user nova-compute[74278]: No targets found.
Oct 30 11:03:02 user nova-compute[74278]: iSNS:
Oct 30 11:03:02 user nova-compute[74278]: No targets found.
Oct 30 11:03:02 user nova-compute[74278]: STATIC:
Oct 30 11:03:02 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3
Oct 30 11:03:02 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:03:02 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:03:02 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:03:02 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:03:02 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:03:02 user nova-compute[74278]: FIRMWARE:
Oct 30 11:03:02 user nova-compute[74278]: No targets found.
Oct 30 11:03:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:03:02 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:03:02 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b2bb36-9c32-4576-ab6c-ae91fb254dac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-dab0de3c-332e-4708-8201-311f7cc26e97 req-6a6121e2-4cd5-48d8-bd0e-92b321f85288 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-dab0de3c-332e-4708-8201-311f7cc26e97 req-6a6121e2-4cd5-48d8-bd0e-92b321f85288 service nova] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-dab0de3c-332e-4708-8201-311f7cc26e97 req-6a6121e2-4cd5-48d8-bd0e-92b321f85288 service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-dab0de3c-332e-4708-8201-311f7cc26e97 req-6a6121e2-4cd5-48d8-bd0e-92b321f85288 service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-dab0de3c-332e-4708-8201-311f7cc26e97 req-6a6121e2-4cd5-48d8-bd0e-92b321f85288 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] No waiting events found dispatching network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:03:02 user nova-compute[74278]: WARNING nova.compute.manager [req-dab0de3c-332e-4708-8201-311f7cc26e97 req-6a6121e2-4cd5-48d8-bd0e-92b321f85288 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received unexpected event network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 for instance with vm_state active and task_state rebuilding.
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c956d42-471d-44f8-9f41-1c304d496412]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:02 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:02 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:02 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c30e950>, {}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Disconnecting from: [] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.096s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] <== disconnect_volume: return (98ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-acaf3798-a2ac-4e16-a7e6-227231b91170 req-7df4f6fa-9aa1-4fb9-bf5a-d1647984bbe4 service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Received event network-vif-plugged-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-acaf3798-a2ac-4e16-a7e6-227231b91170 req-7df4f6fa-9aa1-4fb9-bf5a-d1647984bbe4 service nova] Acquiring lock "283358a3-e52d-4019-8d88-8f86d456122f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-acaf3798-a2ac-4e16-a7e6-227231b91170 req-7df4f6fa-9aa1-4fb9-bf5a-d1647984bbe4 service nova] Lock "283358a3-e52d-4019-8d88-8f86d456122f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-acaf3798-a2ac-4e16-a7e6-227231b91170 req-7df4f6fa-9aa1-4fb9-bf5a-d1647984bbe4 service nova] Lock "283358a3-e52d-4019-8d88-8f86d456122f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-acaf3798-a2ac-4e16-a7e6-227231b91170 req-7df4f6fa-9aa1-4fb9-bf5a-d1647984bbe4 service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] No waiting events found dispatching network-vif-plugged-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:03:02 user nova-compute[74278]: WARNING nova.compute.manager [req-acaf3798-a2ac-4e16-a7e6-227231b91170 req-7df4f6fa-9aa1-4fb9-bf5a-d1647984bbe4 service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Received unexpected event network-vif-plugged-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 for instance with vm_state building and task_state spawning.
Oct 30 11:03:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Preparing to wait for external event volume-reimaged-c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce {{(pid=74278) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 30 11:03:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.volume.cinder [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Update attachment failed for attachment 6113fa1a-e637-49ac-8e2d-c39372a213ff. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b8751d9-4b34-49c0-8018-a1f54d9eaa74) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b8751d9-4b34-49c0-8018-a1f54d9eaa74)
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Failed to attach 60bae430-beff-4060-883e-1bf4b323560e at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b8751d9-4b34-49c0-8018-a1f54d9eaa74)
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Traceback (most recent call last):
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     ret_val = method(obj, context, *args, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     self._do_attach(context, instance, volume, volume_api,
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     self._volume_attach(context, volume, connector, instance,
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     connection_info = volume_api.attachment_update(
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     res = method(self, ctx, *args, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     with excutils.save_and_reraise_exception():
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     self.force_reraise()
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     raise self.value
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     context, '3.44', skip_version_check=True).attachments.update(
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     return method.func(obj, *args, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     resp = self._update('/attachments/%s' % id, body)
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     return self._cs_request(url, 'PUT', **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     return self.request(url, method, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06]     raise exceptions.from_response(resp, body)
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b8751d9-4b34-49c0-8018-a1f54d9eaa74)
Oct 30 11:03:03 user nova-compute[74278]: ERROR nova.compute.manager [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] 
Oct 30 11:03:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.956s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server [None req-9a94cb57-828f-48dc-acbc-ca2b278e3df1 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b8751d9-4b34-49c0-8018-a1f54d9eaa74)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-6b8751d9-4b34-49c0-8018-a1f54d9eaa74)
Oct 30 11:03:03 user nova-compute[74278]: ERROR oslo_messaging.rpc.server 
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-f0808358-dfc3-436c-a1ae-058100c72a25 req-cef77255-0a30-4809-90ee-86fa377fdae8 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-changed-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-f0808358-dfc3-436c-a1ae-058100c72a25 req-cef77255-0a30-4809-90ee-86fa377fdae8 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Refreshing instance network info cache due to event network-changed-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f0808358-dfc3-436c-a1ae-058100c72a25 req-cef77255-0a30-4809-90ee-86fa377fdae8 service nova] Acquiring lock "refresh_cache-e94c4f7c-6e99-4694-84d6-ed62c385a4f9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f0808358-dfc3-436c-a1ae-058100c72a25 req-cef77255-0a30-4809-90ee-86fa377fdae8 service nova] Acquired lock "refresh_cache-e94c4f7c-6e99-4694-84d6-ed62c385a4f9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.network.neutron [req-f0808358-dfc3-436c-a1ae-058100c72a25 req-cef77255-0a30-4809-90ee-86fa377fdae8 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Refreshing network info cache for port d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:03:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Instance spawned successfully.
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-e670be9b-37e8-4c51-90dc-b7a4459eb8d1 req-ea4a5e12-4cab-4d57-9685-697036c5a8fd service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Received event network-vif-plugged-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e670be9b-37e8-4c51-90dc-b7a4459eb8d1 req-ea4a5e12-4cab-4d57-9685-697036c5a8fd service nova] Acquiring lock "283358a3-e52d-4019-8d88-8f86d456122f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e670be9b-37e8-4c51-90dc-b7a4459eb8d1 req-ea4a5e12-4cab-4d57-9685-697036c5a8fd service nova] Lock "283358a3-e52d-4019-8d88-8f86d456122f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e670be9b-37e8-4c51-90dc-b7a4459eb8d1 req-ea4a5e12-4cab-4d57-9685-697036c5a8fd service nova] Lock "283358a3-e52d-4019-8d88-8f86d456122f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-e670be9b-37e8-4c51-90dc-b7a4459eb8d1 req-ea4a5e12-4cab-4d57-9685-697036c5a8fd service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] No waiting events found dispatching network-vif-plugged-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:03:04 user nova-compute[74278]: WARNING nova.compute.manager [req-e670be9b-37e8-4c51-90dc-b7a4459eb8d1 req-ea4a5e12-4cab-4d57-9685-697036c5a8fd service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Received unexpected event network-vif-plugged-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 for instance with vm_state building and task_state spawning.
Oct 30 11:03:04 user nova-compute[74278]: INFO nova.compute.manager [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Took 8.27 seconds to spawn the instance on the hypervisor.
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.network.neutron [req-f0808358-dfc3-436c-a1ae-058100c72a25 req-cef77255-0a30-4809-90ee-86fa377fdae8 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Updated VIF entry in instance network info cache for port d0cd08c8-6f28-46d3-a6ad-c2b65ef16803. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.network.neutron [req-f0808358-dfc3-436c-a1ae-058100c72a25 req-cef77255-0a30-4809-90ee-86fa377fdae8 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Updating instance_info_cache with network_info: [{"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f0808358-dfc3-436c-a1ae-058100c72a25 req-cef77255-0a30-4809-90ee-86fa377fdae8 service nova] Releasing lock "refresh_cache-e94c4f7c-6e99-4694-84d6-ed62c385a4f9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:04 user nova-compute[74278]: INFO nova.compute.manager [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Took 9.62 seconds to build instance.
Oct 30 11:03:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e7fe97e-9fb3-4650-91a3-e0c92dbe04ee tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "283358a3-e52d-4019-8d88-8f86d456122f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.738s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lazy-loading 'flavor' on Instance uuid e94c4f7c-6e99-4694-84d6-ed62c385a4f9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:03:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:05 user nova-compute[74278]: INFO nova.compute.manager [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Attaching volume 5feb7441-95f8-4d76-a055-1bd22f0678f2 to /dev/vdb
Oct 30 11:03:05 user nova-compute[74278]: DEBUG os_brick.utils [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e8eca3-4703-4378-90e9-5526fc355d03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:05 user nova-compute[74278]: INFO nova.compute.manager [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Terminating instance
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[70671dfc-a179-43e1-91d1-ee16f695d161]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fa8d6f-8c42-4851-861d-2c27d60a52ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8e7fe5-886b-4647-9cef-a77471d43028]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:03:05 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edb2cdc-945d-4cd0-9c58-6479e86175a4]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG os_brick.utils [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Updating existing volume attachment record: 0efc33eb-d07f-41b0-967c-796a3025dc10 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-729f008c-5da6-4108-a2be-ffd25326f0ec req-95c804da-1386-4fe6-a2fa-a2e304e019ee service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Received event network-vif-unplugged-42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-729f008c-5da6-4108-a2be-ffd25326f0ec req-95c804da-1386-4fe6-a2fa-a2e304e019ee service nova] Acquiring lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-729f008c-5da6-4108-a2be-ffd25326f0ec req-95c804da-1386-4fe6-a2fa-a2e304e019ee service nova] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-729f008c-5da6-4108-a2be-ffd25326f0ec req-95c804da-1386-4fe6-a2fa-a2e304e019ee service nova] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-729f008c-5da6-4108-a2be-ffd25326f0ec req-95c804da-1386-4fe6-a2fa-a2e304e019ee service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] No waiting events found dispatching network-vif-unplugged-42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:03:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-729f008c-5da6-4108-a2be-ffd25326f0ec req-95c804da-1386-4fe6-a2fa-a2e304e019ee service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Received event network-vif-unplugged-42f486b0-bbf0-41a3-b93a-1647f97bf631 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:06 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Instance destroyed successfully.
Oct 30 11:03:06 user nova-compute[74278]: DEBUG nova.objects.instance [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lazy-loading 'resources' on Instance uuid 23852f7e-6e4a-4e19-91ff-d9914c04cf83 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-376650337',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-376650337',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3766503',id=24,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxqVcC4a3t7e5BnTNviY7fJgqWMeeNHqVK+jDq5sL2KqzDzSBJVA9+WioK1LY+nL95vZLaFOgaPeaOxVgwMcvUzBSRKuR7ctzOw6nX3Z0ycXKd5oQJAzf2ryyxfm1LYKQ==',key_name='tempest-keypair-587155817',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:59:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2474a648f3b48ac9a43b07b77f9d6e4',ramdisk_id='',reservation_id='r-o1seeb1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1692465110',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:59:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4c1fb22bbcf4405b0b9da85475494a4',uuid=23852f7e-6e4a-4e19-91ff-d9914c04cf83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "address": "fa:16:3e:37:3e:a6", "network": {"id": "e3277ec0-08f4-4186-8b28-31a9c9112aac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1499901778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2474a648f3b48ac9a43b07b77f9d6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42f486b0-bb", "ovs_interfaceid": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Converting VIF {"id": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "address": "fa:16:3e:37:3e:a6", "network": {"id": "e3277ec0-08f4-4186-8b28-31a9c9112aac", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1499901778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2474a648f3b48ac9a43b07b77f9d6e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42f486b0-bb", "ovs_interfaceid": "42f486b0-bbf0-41a3-b93a-1647f97bf631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=42f486b0-bbf0-41a3-b93a-1647f97bf631,network=Network(e3277ec0-08f4-4186-8b28-31a9c9112aac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42f486b0-bb') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG os_vif [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=42f486b0-bbf0-41a3-b93a-1647f97bf631,network=Network(e3277ec0-08f4-4186-8b28-31a9c9112aac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42f486b0-bb') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42f486b0-bb, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f8fee20-81d8-4a6b-be6e-09a9fb3e9bfa) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:03:06 user nova-compute[74278]: INFO os_vif [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:3e:a6,bridge_name='br-int',has_traffic_filtering=True,id=42f486b0-bbf0-41a3-b93a-1647f97bf631,network=Network(e3277ec0-08f4-4186-8b28-31a9c9112aac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42f486b0-bb')
Oct 30 11:03:06 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Deleting instance files /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83_del
Oct 30 11:03:06 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Deletion of /opt/stack/data/nova/instances/23852f7e-6e4a-4e19-91ff-d9914c04cf83_del complete
Oct 30 11:03:06 user nova-compute[74278]: INFO nova.compute.manager [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 30 11:03:06 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:03:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:07 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:03:07 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Took 1.05 seconds to deallocate network for instance.
Oct 30 11:03:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-c6ff2a09-e017-48c1-aeac-07027d287a0c req-3e8a5614-e57e-4553-8f97-007b07245455 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Received event network-vif-plugged-42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c6ff2a09-e017-48c1-aeac-07027d287a0c req-3e8a5614-e57e-4553-8f97-007b07245455 service nova] Acquiring lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c6ff2a09-e017-48c1-aeac-07027d287a0c req-3e8a5614-e57e-4553-8f97-007b07245455 service nova] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c6ff2a09-e017-48c1-aeac-07027d287a0c req-3e8a5614-e57e-4553-8f97-007b07245455 service nova] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-c6ff2a09-e017-48c1-aeac-07027d287a0c req-3e8a5614-e57e-4553-8f97-007b07245455 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] No waiting events found dispatching network-vif-plugged-42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:03:07 user nova-compute[74278]: WARNING nova.compute.manager [req-c6ff2a09-e017-48c1-aeac-07027d287a0c req-3e8a5614-e57e-4553-8f97-007b07245455 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Received unexpected event network-vif-plugged-42f486b0-bbf0-41a3-b93a-1647f97bf631 for instance with vm_state deleted and task_state None.
Oct 30 11:03:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-c6ff2a09-e017-48c1-aeac-07027d287a0c req-3e8a5614-e57e-4553-8f97-007b07245455 service nova] [instance: 23852f7e-6e4a-4e19-91ff-d9914c04cf83] Received event network-vif-deleted-42f486b0-bbf0-41a3-b93a-1647f97bf631 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:08 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:03:08 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:03:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:08 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Deleted allocations for instance 23852f7e-6e4a-4e19-91ff-d9914c04cf83
Oct 30 11:03:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d879d3fb-3746-435e-8249-31e004fb4725 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110 tempest-TestServerVolumeAttachScenarioOldVersion-1692465110-project-member] Lock "23852f7e-6e4a-4e19-91ff-d9914c04cf83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.925s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Acquiring lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:03:16 user nova-compute[74278]: INFO nova.compute.claims [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Claim successful on node user
Oct 30 11:03:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:03:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:03:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG nova.policy [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '352cbfc844d24e1a8a88d8d5337fe86c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513ca266d91348d69eff751ba2e9293d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:03:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Creating image(s)
Oct 30 11:03:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Acquiring lock "/opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "/opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "/opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Successfully created port: 1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk 1073741824" returned: 0 in 0.049s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Cannot resize image /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Ensure instance console log exists: /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Successfully updated port: 1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Acquiring lock "refresh_cache-a30a0e67-5274-4f10-9f88-038dfe0e4fbf" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Acquired lock "refresh_cache-a30a0e67-5274-4f10-9f88-038dfe0e4fbf" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-6806b35d-1a84-4f19-8cd9-eca005ffa2ef req-d3e9a998-f1e4-417b-880d-cd3ff094f510 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Received event network-changed-1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-6806b35d-1a84-4f19-8cd9-eca005ffa2ef req-d3e9a998-f1e4-417b-880d-cd3ff094f510 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Refreshing instance network info cache due to event network-changed-1dc80ae1-599d-490f-85c2-ebef7f7576be. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6806b35d-1a84-4f19-8cd9-eca005ffa2ef req-d3e9a998-f1e4-417b-880d-cd3ff094f510 service nova] Acquiring lock "refresh_cache-a30a0e67-5274-4f10-9f88-038dfe0e4fbf" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Updating instance_info_cache with network_info: [{"id": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "address": "fa:16:3e:b5:89:df", "network": {"id": "d308659f-8977-4087-a7a5-1996c6c7879c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-835205329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513ca266d91348d69eff751ba2e9293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc80ae1-59", "ovs_interfaceid": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Releasing lock "refresh_cache-a30a0e67-5274-4f10-9f88-038dfe0e4fbf" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Instance network_info: |[{"id": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "address": "fa:16:3e:b5:89:df", "network": {"id": "d308659f-8977-4087-a7a5-1996c6c7879c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-835205329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513ca266d91348d69eff751ba2e9293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc80ae1-59", "ovs_interfaceid": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6806b35d-1a84-4f19-8cd9-eca005ffa2ef req-d3e9a998-f1e4-417b-880d-cd3ff094f510 service nova] Acquired lock "refresh_cache-a30a0e67-5274-4f10-9f88-038dfe0e4fbf" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-6806b35d-1a84-4f19-8cd9-eca005ffa2ef req-d3e9a998-f1e4-417b-880d-cd3ff094f510 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Refreshing network info cache for port 1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Start _get_guest_xml network_info=[{"id": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "address": "fa:16:3e:b5:89:df", "network": {"id": "d308659f-8977-4087-a7a5-1996c6c7879c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-835205329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513ca266d91348d69eff751ba2e9293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc80ae1-59", "ovs_interfaceid": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:03:18 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:03:18 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1254837131',display_name='tempest-VolumesActionsTest-instance-1254837131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1254837131',id=31,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513ca266d91348d69eff751ba2e9293d',ramdisk_id='',reservation_id='r-olkwe2td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-309200444',owner_user_name='tempest-VolumesActionsTest-309200444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:03:17Z,user_data=None,user_id='352cbfc844d24e1a8a88d8d5337fe86c',uuid=a30a0e67-5274-4f10-9f88-038dfe0e4fbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "address": "fa:16:3e:b5:89:df", "network": {"id": "d308659f-8977-4087-a7a5-1996c6c7879c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-835205329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513ca266d91348d69eff751ba2e9293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc80ae1-59", "ovs_interfaceid": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Converting VIF {"id": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "address": "fa:16:3e:b5:89:df", "network": {"id": "d308659f-8977-4087-a7a5-1996c6c7879c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-835205329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513ca266d91348d69eff751ba2e9293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc80ae1-59", "ovs_interfaceid": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:89:df,bridge_name='br-int',has_traffic_filtering=True,id=1dc80ae1-599d-490f-85c2-ebef7f7576be,network=Network(d308659f-8977-4087-a7a5-1996c6c7879c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc80ae1-59') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.objects.instance [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lazy-loading 'pci_devices' on Instance uuid a30a0e67-5274-4f10-9f88-038dfe0e4fbf {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:03:18 user nova-compute[74278]:   <uuid>a30a0e67-5274-4f10-9f88-038dfe0e4fbf</uuid>
Oct 30 11:03:18 user nova-compute[74278]:   <name>instance-0000001f</name>
Oct 30 11:03:18 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:03:18 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:03:18 user nova-compute[74278]:   <metadata>
Oct 30 11:03:18 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:03:18 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:03:18 user nova-compute[74278]:       <nova:name>tempest-VolumesActionsTest-instance-1254837131</nova:name>
Oct 30 11:03:18 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:03:18</nova:creationTime>
Oct 30 11:03:18 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:03:18 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:03:18 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:03:18 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:03:18 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:03:18 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:03:18 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:03:18 user nova-compute[74278]:       <nova:owner>
Oct 30 11:03:18 user nova-compute[74278]:         <nova:user uuid="352cbfc844d24e1a8a88d8d5337fe86c">tempest-VolumesActionsTest-309200444-project-member</nova:user>
Oct 30 11:03:18 user nova-compute[74278]:         <nova:project uuid="513ca266d91348d69eff751ba2e9293d">tempest-VolumesActionsTest-309200444</nova:project>
Oct 30 11:03:18 user nova-compute[74278]:       </nova:owner>
Oct 30 11:03:18 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:03:18 user nova-compute[74278]:       <nova:ports>
Oct 30 11:03:18 user nova-compute[74278]:         <nova:port uuid="1dc80ae1-599d-490f-85c2-ebef7f7576be">
Oct 30 11:03:18 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 11:03:18 user nova-compute[74278]:         </nova:port>
Oct 30 11:03:18 user nova-compute[74278]:       </nova:ports>
Oct 30 11:03:18 user nova-compute[74278]:     </nova:instance>
Oct 30 11:03:18 user nova-compute[74278]:   </metadata>
Oct 30 11:03:18 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:03:18 user nova-compute[74278]:     <system>
Oct 30 11:03:18 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:03:18 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:03:18 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:03:18 user nova-compute[74278]:       <entry name="serial">a30a0e67-5274-4f10-9f88-038dfe0e4fbf</entry>
Oct 30 11:03:18 user nova-compute[74278]:       <entry name="uuid">a30a0e67-5274-4f10-9f88-038dfe0e4fbf</entry>
Oct 30 11:03:18 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:03:18 user nova-compute[74278]:     </system>
Oct 30 11:03:18 user nova-compute[74278]:   </sysinfo>
Oct 30 11:03:18 user nova-compute[74278]:   <os>
Oct 30 11:03:18 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:03:18 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:03:18 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:03:18 user nova-compute[74278]:   </os>
Oct 30 11:03:18 user nova-compute[74278]:   <features>
Oct 30 11:03:18 user nova-compute[74278]:     <acpi/>
Oct 30 11:03:18 user nova-compute[74278]:     <apic/>
Oct 30 11:03:18 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:03:18 user nova-compute[74278]:   </features>
Oct 30 11:03:18 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:03:18 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:03:18 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:03:18 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:03:18 user nova-compute[74278]:   </clock>
Oct 30 11:03:18 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:03:18 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:03:18 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:03:18 user nova-compute[74278]:   </cpu>
Oct 30 11:03:18 user nova-compute[74278]:   <devices>
Oct 30 11:03:18 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:03:18 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:03:18 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk"/>
Oct 30 11:03:18 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:03:18 user nova-compute[74278]:     </disk>
Oct 30 11:03:18 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:03:18 user nova-compute[74278]:       <mac address="fa:16:3e:b5:89:df"/>
Oct 30 11:03:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:03:18 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:03:18 user nova-compute[74278]:       <target dev="tap1dc80ae1-59"/>
Oct 30 11:03:18 user nova-compute[74278]:     </interface>
Oct 30 11:03:18 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:03:18 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/console.log" append="off"/>
Oct 30 11:03:18 user nova-compute[74278]:     </serial>
Oct 30 11:03:18 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:03:18 user nova-compute[74278]:     <video>
Oct 30 11:03:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:03:18 user nova-compute[74278]:     </video>
Oct 30 11:03:18 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:03:18 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:03:18 user nova-compute[74278]:     </rng>
Oct 30 11:03:18 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:03:18 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:03:18 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:03:18 user nova-compute[74278]:     </memballoon>
Oct 30 11:03:18 user nova-compute[74278]:   </devices>
Oct 30 11:03:18 user nova-compute[74278]: </domain>
Oct 30 11:03:18 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1254837131',display_name='tempest-VolumesActionsTest-instance-1254837131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1254837131',id=31,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='513ca266d91348d69eff751ba2e9293d',ramdisk_id='',reservation_id='r-olkwe2td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-309200444',owner_user_name='tempest-VolumesActionsTest-309200444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:03:17Z,user_data=None,user_id='352cbfc844d24e1a8a88d8d5337fe86c',uuid=a30a0e67-5274-4f10-9f88-038dfe0e4fbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "address": "fa:16:3e:b5:89:df", "network": {"id": "d308659f-8977-4087-a7a5-1996c6c7879c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-835205329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513ca266d91348d69eff751ba2e9293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc80ae1-59", "ovs_interfaceid": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Converting VIF {"id": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "address": "fa:16:3e:b5:89:df", "network": {"id": "d308659f-8977-4087-a7a5-1996c6c7879c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-835205329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513ca266d91348d69eff751ba2e9293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc80ae1-59", "ovs_interfaceid": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:89:df,bridge_name='br-int',has_traffic_filtering=True,id=1dc80ae1-599d-490f-85c2-ebef7f7576be,network=Network(d308659f-8977-4087-a7a5-1996c6c7879c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc80ae1-59') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG os_vif [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:89:df,bridge_name='br-int',has_traffic_filtering=True,id=1dc80ae1-599d-490f-85c2-ebef7f7576be,network=Network(d308659f-8977-4087-a7a5-1996c6c7879c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc80ae1-59') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '198b7b9b-2482-555f-8193-a4d447743d6b', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dc80ae1-59, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dc80ae1-59, col_values=(('qos', UUID('f295103f-52a6-439a-81ba-a5349a985f1c')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dc80ae1-59, col_values=(('external_ids', {'iface-id': '1dc80ae1-599d-490f-85c2-ebef7f7576be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:89:df', 'vm-uuid': 'a30a0e67-5274-4f10-9f88-038dfe0e4fbf'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:18 user nova-compute[74278]: INFO os_vif [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:89:df,bridge_name='br-int',has_traffic_filtering=True,id=1dc80ae1-599d-490f-85c2-ebef7f7576be,network=Network(d308659f-8977-4087-a7a5-1996c6c7879c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc80ae1-59')
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:03:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] No VIF found with MAC fa:16:3e:b5:89:df, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:03:19 user nova-compute[74278]: DEBUG nova.network.neutron [req-6806b35d-1a84-4f19-8cd9-eca005ffa2ef req-d3e9a998-f1e4-417b-880d-cd3ff094f510 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Updated VIF entry in instance network info cache for port 1dc80ae1-599d-490f-85c2-ebef7f7576be. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:03:19 user nova-compute[74278]: DEBUG nova.network.neutron [req-6806b35d-1a84-4f19-8cd9-eca005ffa2ef req-d3e9a998-f1e4-417b-880d-cd3ff094f510 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Updating instance_info_cache with network_info: [{"id": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "address": "fa:16:3e:b5:89:df", "network": {"id": "d308659f-8977-4087-a7a5-1996c6c7879c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-835205329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513ca266d91348d69eff751ba2e9293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc80ae1-59", "ovs_interfaceid": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:03:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6806b35d-1a84-4f19-8cd9-eca005ffa2ef req-d3e9a998-f1e4-417b-880d-cd3ff094f510 service nova] Releasing lock "refresh_cache-a30a0e67-5274-4f10-9f88-038dfe0e4fbf" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:03:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-cc48875c-77cc-4465-b12b-9bc13b86fde4 req-e1d520dc-d62f-42ac-90a1-6c20bec081fb service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Received event network-vif-plugged-1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-cc48875c-77cc-4465-b12b-9bc13b86fde4 req-e1d520dc-d62f-42ac-90a1-6c20bec081fb service nova] Acquiring lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-cc48875c-77cc-4465-b12b-9bc13b86fde4 req-e1d520dc-d62f-42ac-90a1-6c20bec081fb service nova] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-cc48875c-77cc-4465-b12b-9bc13b86fde4 req-e1d520dc-d62f-42ac-90a1-6c20bec081fb service nova] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-cc48875c-77cc-4465-b12b-9bc13b86fde4 req-e1d520dc-d62f-42ac-90a1-6c20bec081fb service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] No waiting events found dispatching network-vif-plugged-1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:03:20 user nova-compute[74278]: WARNING nova.compute.manager [req-cc48875c-77cc-4465-b12b-9bc13b86fde4 req-e1d520dc-d62f-42ac-90a1-6c20bec081fb service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Received unexpected event network-vif-plugged-1dc80ae1-599d-490f-85c2-ebef7f7576be for instance with vm_state building and task_state spawning.
Oct 30 11:03:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:03:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Instance spawned successfully.
Oct 30 11:03:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-78948918-c36d-42f7-823d-03e39b127151 req-0822a0f8-9bc4-41ca-bef9-8bba56ab65c7 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Received event network-vif-plugged-1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-78948918-c36d-42f7-823d-03e39b127151 req-0822a0f8-9bc4-41ca-bef9-8bba56ab65c7 service nova] Acquiring lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-78948918-c36d-42f7-823d-03e39b127151 req-0822a0f8-9bc4-41ca-bef9-8bba56ab65c7 service nova] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-78948918-c36d-42f7-823d-03e39b127151 req-0822a0f8-9bc4-41ca-bef9-8bba56ab65c7 service nova] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-78948918-c36d-42f7-823d-03e39b127151 req-0822a0f8-9bc4-41ca-bef9-8bba56ab65c7 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] No waiting events found dispatching network-vif-plugged-1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:03:22 user nova-compute[74278]: WARNING nova.compute.manager [req-78948918-c36d-42f7-823d-03e39b127151 req-0822a0f8-9bc4-41ca-bef9-8bba56ab65c7 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Received unexpected event network-vif-plugged-1dc80ae1-599d-490f-85c2-ebef7f7576be for instance with vm_state building and task_state spawning.
Oct 30 11:03:22 user nova-compute[74278]: INFO nova.compute.manager [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Took 5.40 seconds to spawn the instance on the hypervisor.
Oct 30 11:03:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:03:22 user nova-compute[74278]: INFO nova.compute.manager [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Took 6.32 seconds to build instance.
Oct 30 11:03:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c0665ef7-c9ba-4961-8723-a24ef5c18ff6 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.420s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:25 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:03:26 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:03:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoweczUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:03:27 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:03:27 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:03:27 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d2ac7c-f3fd-434c-b6fa-01bd86fe8f4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:03:27 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd18245-b74a-4b2f-b55b-5d0920606ff9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2] added
Oct 30 11:03:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2347a2c0-22e8-4aab-996f-abf9bb7e6ea5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a4da6c-c403-44cc-b7bc-36db96259cf7]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoweczUm {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoweczUm" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c6733d-110a-4ee8-84e9-03920c9df914]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoweczUm'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2cd394-ede8-48b5-a14f-edc1947997ad]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7769b63e-57a6-4316-b099-840692bdc55e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:27 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:27 user nova-compute[74278]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:03:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:27 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:27 user nova-compute[74278]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:03:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2457cc5d-87a2-4ecf-83da-86111d53e315]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260]
Oct 30 11:03:27 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260] successful.
Oct 30 11:03:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[553352d7-da1d-4677-acd0-ca4991b34aaa]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cb1794-e512-4038-a993-6049cfa8ca2a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:27 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:27 user nova-compute[74278]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:03:27 user nova-compute[74278]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:03:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:27 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:27 user nova-compute[74278]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:03:27 user nova-compute[74278]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:03:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ea76dd-ac2c-42b2-aecc-161a27bc765a]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:03:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoweczUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:03:28 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updating instance_info_cache with network_info: [{"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:03:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:03:28 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:03:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:03:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:03:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:03:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:03:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26561653762386162', 'path': '/dev/sdd'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:03:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561653762386162', 'path': '/dev/sdd'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:03:29 user nova-compute[74278]: DEBUG nova.objects.instance [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lazy-loading 'flavor' on Instance uuid e94c4f7c-6e99-4694-84d6-ed62c385a4f9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:03:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:03:29 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:03:29 user nova-compute[74278]:   <source dev="/dev/sdd"/>
Oct 30 11:03:29 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:03:29 user nova-compute[74278]:   <serial>5feb7441-95f8-4d76-a055-1bd22f0678f2</serial>
Oct 30 11:03:29 user nova-compute[74278]: </disk>
Oct 30 11:03:29 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:03:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:03:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:03:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No VIF found with MAC fa:16:3e:f9:3c:94, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:03:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-19d2eb28-274c-4a4c-bb66-a505af5af2a3 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.542s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:03:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:03:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:30 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:03:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:30 user nova-compute[74278]: INFO nova.compute.manager [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Rebuilding instance
Oct 30 11:03:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG nova.compute.manager [req-f5295587-61c4-45cb-99ea-6d1e128d831e req-fdb95433-e63c-4ed7-9c4d-b574a02a0902 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-unplugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f5295587-61c4-45cb-99ea-6d1e128d831e req-fdb95433-e63c-4ed7-9c4d-b574a02a0902 service nova] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f5295587-61c4-45cb-99ea-6d1e128d831e req-fdb95433-e63c-4ed7-9c4d-b574a02a0902 service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f5295587-61c4-45cb-99ea-6d1e128d831e req-fdb95433-e63c-4ed7-9c4d-b574a02a0902 service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG nova.compute.manager [req-f5295587-61c4-45cb-99ea-6d1e128d831e req-fdb95433-e63c-4ed7-9c4d-b574a02a0902 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] No waiting events found dispatching network-vif-unplugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:03:31 user nova-compute[74278]: WARNING nova.compute.manager [req-f5295587-61c4-45cb-99ea-6d1e128d831e req-fdb95433-e63c-4ed7-9c4d-b574a02a0902 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received unexpected event network-vif-unplugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 for instance with vm_state active and task_state rebuilding.
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Instance destroyed successfully.
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: INFO nova.compute.manager [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Detaching volume 5feb7441-95f8-4d76-a055-1bd22f0678f2
Oct 30 11:03:32 user nova-compute[74278]: INFO nova.virt.block_device [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Attempting to driver detach volume 5feb7441-95f8-4d76-a055-1bd22f0678f2 from mountpoint /dev/vdb
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Attempting to detach device vdb from instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:03:32 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:03:32 user nova-compute[74278]:   <source dev="/dev/sdd"/>
Oct 30 11:03:32 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:03:32 user nova-compute[74278]:   <serial>5feb7441-95f8-4d76-a055-1bd22f0678f2</serial>
Oct 30 11:03:32 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:03:32 user nova-compute[74278]: </disk>
Oct 30 11:03:32 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:03:32 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully detached device vdb from instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 from the persistent domain config.
Oct 30 11:03:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoweczUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:03:32 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f129f04-74bb-426c-b8f4-d5ec1adfecc2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:03:32 user nova-compute[74278]: No targets found.
Oct 30 11:03:32 user nova-compute[74278]: iSNS:
Oct 30 11:03:32 user nova-compute[74278]: No targets found.
Oct 30 11:03:32 user nova-compute[74278]: STATIC:
Oct 30 11:03:32 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2
Oct 30 11:03:32 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:03:32 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:03:32 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3
Oct 30 11:03:32 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:03:32 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:03:32 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:03:32 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:03:32 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:03:32 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce
Oct 30 11:03:32 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:03:32 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:03:32 user nova-compute[74278]: FIRMWARE:
Oct 30 11:03:32 user nova-compute[74278]: No targets found.
Oct 30 11:03:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:03:32 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:03:32 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1d0052-bf5e-4718-85db-427c67f2e3e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b140d968-21e5-4699-b907-e205de0f5eb5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:32 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:32 user nova-compute[74278]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:03:32 user nova-compute[74278]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:03:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:32 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:32 user nova-compute[74278]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:03:32 user nova-compute[74278]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:03:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c117760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2'): ({'sdd'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Removing single pathed devices sdd {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[54023371-0aca-463c-969f-fba5e2995c17]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c071281-e3d3-4a18-92b9-de4fd4e5e039]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flushing IO for device /dev/sdd {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d83989-dcd1-488b-96d7-7fefb8a2355f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1897194-4de8-4e34-b7c6-0e30b628de5a]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8676bd0b-3c03-4b91-b459-40c39d03696a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0cabfe-600f-474d-90dc-9a16637650bd]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260]
Oct 30 11:03:32 user nova-compute[74278]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260] successful.
Oct 30 11:03:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9b1124-13f0-4a02-809c-9305d698524f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== disconnect_volume: return (375ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG nova.compute.manager [req-20d2b2c6-8bfa-4202-8d96-5ca74e5dac6e req-f2817f8d-f36f-401c-9e40-738ce3683a54 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-20d2b2c6-8bfa-4202-8d96-5ca74e5dac6e req-f2817f8d-f36f-401c-9e40-738ce3683a54 service nova] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-20d2b2c6-8bfa-4202-8d96-5ca74e5dac6e req-f2817f8d-f36f-401c-9e40-738ce3683a54 service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-20d2b2c6-8bfa-4202-8d96-5ca74e5dac6e req-f2817f8d-f36f-401c-9e40-738ce3683a54 service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG nova.compute.manager [req-20d2b2c6-8bfa-4202-8d96-5ca74e5dac6e req-f2817f8d-f36f-401c-9e40-738ce3683a54 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] No waiting events found dispatching network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:03:33 user nova-compute[74278]: WARNING nova.compute.manager [req-20d2b2c6-8bfa-4202-8d96-5ca74e5dac6e req-f2817f8d-f36f-401c-9e40-738ce3683a54 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received unexpected event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 for instance with vm_state active and task_state rebuilding.
Oct 30 11:03:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:33 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Instance destroyed successfully.
Oct 30 11:03:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-271667642',display_name='tempest-ServerActionsTestOtherA-server-2045755829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-271667642',id=27,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD4PHb/9XzyvWLBbPO6wny4wEPuXFI3gaSrqSdwmjCZkbsuAHJH7SKFqW6FChsnRgIXFl9df68Jt5kVrUhD4iFw8HDLHHScd2I9aHIHob65iYrnC7ObhbXR1SqG3E6kOA==',key_name='tempest-keypair-433171770',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-5otvhosk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=e94c4f7c-6e99-4694-84d6-ed62c385a4f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG os_vif [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0cd08c8-6f, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=403316f6-6d3c-49cd-8e3d-352537b3150b) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:03:33 user nova-compute[74278]: INFO os_vif [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f')
Oct 30 11:03:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoweczUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:03:33 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 11:03:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[57408233-e570-419f-acf5-89d54206467e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:03:33 user nova-compute[74278]: No targets found.
Oct 30 11:03:33 user nova-compute[74278]: iSNS:
Oct 30 11:03:33 user nova-compute[74278]: No targets found.
Oct 30 11:03:33 user nova-compute[74278]: STATIC:
Oct 30 11:03:33 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3
Oct 30 11:03:33 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:03:33 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:03:33 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:03:33 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:03:33 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:03:33 user nova-compute[74278]: FIRMWARE:
Oct 30 11:03:33 user nova-compute[74278]: No targets found.
Oct 30 11:03:33 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:03:33 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:03:33 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bf8137-3c53-46ea-8fd6-acc20e817d68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe97032-4813-4075-9480-f5e869d6289c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:34 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:34 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:34 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:34 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac26c700>, {}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Disconnecting from: [] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.104s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== disconnect_volume: return (108ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:03:34 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Deleting instance files /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9_del
Oct 30 11:03:34 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Deletion of /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9_del complete
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:34 user nova-compute[74278]: INFO nova.virt.block_device [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Booting with volume 5feb7441-95f8-4d76-a055-1bd22f0678f2 at /dev/vdb
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.utils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48cfa46-2839-4ea1-b8ee-6e25f60f5594]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a4e268-2938-4cfb-b94b-f7355eca40a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5426202-1d31-45dd-bdda-0d72f87f6e09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.manager [req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba req-2efb79ef-935e-47eb-821b-4e4952fdae51 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event volume-reimaged-c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba req-2efb79ef-935e-47eb-821b-4e4952fdae51 service nova] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba req-2efb79ef-935e-47eb-821b-4e4952fdae51 service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba req-2efb79ef-935e-47eb-821b-4e4952fdae51 service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.manager [req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba req-2efb79ef-935e-47eb-821b-4e4952fdae51 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Processing event volume-reimaged-c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Instance event wait completed in 31 seconds for volume-reimaged {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b94a86-9d1d-4d23-b7b8-f377ea730bf6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:03:34 user nova-compute[74278]: INFO nova.virt.block_device [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Booting with volume c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce at /dev/vda
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:03:34 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1d4ef0-2cd0-45e8-bb59-e906dbda5411]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.utils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== get_connector_properties: return (527ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Updating existing volume attachment record: 85e8a3b6-afc7-45cc-bdc1-d707ae553984 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:03:34 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:03:34 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7161MB free_disk=24.836986541748047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG os_brick.utils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74e1694-ca61-4a52-90c1-7b8530c1a42e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[977db162-3cc4-487b-8f1f-f39ee4b237be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[548d0588-df80-4b0a-9898-319d7aaa6ce4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4ce480-ab74-4277-9f8f-3b03af51a0ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 64287717-7d3b-4087-aedf-faf87be774a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2b8efca4-cec4-4179-99af-92172f9b8a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 3d76b06b-9009-4879-83f4-819b1d20ce6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance ef2b0994-a1be-49f5-8617-7fedfeaeca6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 6d868c1e-1985-48b6-a881-4d17b364701a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 283358a3-e52d-4019-8d88-8f86d456122f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a30a0e67-5274-4f10-9f88-038dfe0e4fbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:03:34 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:03:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:03:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:03:35 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:03:35 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[52351d15-a82e-493e-b2b3-c61cebeacc3c]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:03:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:03:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:03:35 user nova-compute[74278]: DEBUG os_brick.utils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:03:35 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Updating existing volume attachment record: a66d7adf-f320-4c53-b4a1-644a9cf9ffcc {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:03:35 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:03:35 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:03:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:03:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:03:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-2697e66a-0254-4684-9704-afaa77498f16 req-05e28b8e-5ac6-44dc-86d2-c2a4fff66c9c service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-changed-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-2697e66a-0254-4684-9704-afaa77498f16 req-05e28b8e-5ac6-44dc-86d2-c2a4fff66c9c service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Refreshing instance network info cache due to event network-changed-3138d8fd-1eed-4c93-ad49-bddc7e9bed81. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:03:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2697e66a-0254-4684-9704-afaa77498f16 req-05e28b8e-5ac6-44dc-86d2-c2a4fff66c9c service nova] Acquiring lock "refresh_cache-ef2b0994-a1be-49f5-8617-7fedfeaeca6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:03:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2697e66a-0254-4684-9704-afaa77498f16 req-05e28b8e-5ac6-44dc-86d2-c2a4fff66c9c service nova] Acquired lock "refresh_cache-ef2b0994-a1be-49f5-8617-7fedfeaeca6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:03:41 user nova-compute[74278]: DEBUG nova.network.neutron [req-2697e66a-0254-4684-9704-afaa77498f16 req-05e28b8e-5ac6-44dc-86d2-c2a4fff66c9c service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Refreshing network info cache for port 3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:03:41 user nova-compute[74278]: DEBUG nova.network.neutron [req-2697e66a-0254-4684-9704-afaa77498f16 req-05e28b8e-5ac6-44dc-86d2-c2a4fff66c9c service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Updated VIF entry in instance network info cache for port 3138d8fd-1eed-4c93-ad49-bddc7e9bed81. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:03:41 user nova-compute[74278]: DEBUG nova.network.neutron [req-2697e66a-0254-4684-9704-afaa77498f16 req-05e28b8e-5ac6-44dc-86d2-c2a4fff66c9c service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Updating instance_info_cache with network_info: [{"id": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "address": "fa:16:3e:59:0c:4c", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3138d8fd-1e", "ovs_interfaceid": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:03:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2697e66a-0254-4684-9704-afaa77498f16 req-05e28b8e-5ac6-44dc-86d2-c2a4fff66c9c service nova] Releasing lock "refresh_cache-ef2b0994-a1be-49f5-8617-7fedfeaeca6c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:03:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG nova.objects.instance [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'flavor' on Instance uuid ef2b0994-a1be-49f5-8617-7fedfeaeca6c {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:47 user nova-compute[74278]: INFO nova.compute.manager [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Attaching volume 813a3d71-058d-46e5-8e1d-e2056808db3f to /dev/vdb
Oct 30 11:03:47 user nova-compute[74278]: DEBUG os_brick.utils [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a319d87c-ebe9-4561-8a00-6f0999711622]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3dd9c9-89a6-4ef4-a2ec-8810076e8cba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d022a34-2bb7-499c-bdd3-4c813c60df20]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34b3848-7e36-430c-9762-a51dab520336]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:47 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:03:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:03:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:03:48 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:03:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f42cb1a-4b66-4c56-9030-0139ec2ea7fe]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:03:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:03:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:03:48 user nova-compute[74278]: DEBUG os_brick.utils [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:03:48 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Updating existing volume attachment record: 6b20de11-f6ee-46f8-96f3-6fc255ca90c8 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:03:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:03:55 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Creating image(s)
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "/opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "/opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "/opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.200s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk 1073741824" returned: 0 in 0.051s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:03:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Cannot resize image /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Ensure instance console log exists: /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Start _get_guest_xml network_info=[{"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoweczUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e94c4f7c-6e99-4694-84d6-ed62c385a4f9', 'attached_at': '', 'detached_at': '', 'volume_id': '5feb7441-95f8-4d76-a055-1bd22f0678f2', 'serial': '5feb7441-95f8-4d76-a055-1bd22f0678f2'}, 'attachment_id': '85e8a3b6-afc7-45cc-bdc1-d707ae553984', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:03:56 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 30 11:03:56 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lazy-loading 'vcpu_model' on Instance uuid e94c4f7c-6e99-4694-84d6-ed62c385a4f9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoweczUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:03:56 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:03:56 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:03:56 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2760cb41-5562-41c4-9c46-13f9451a49ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:03:56 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f737512e-2d7e-4788-b300-7bce94ec74ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2] added
Oct 30 11:03:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c65035-d3e8-4697-8422-f2ce8c418ec4]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.079s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac77185a-dcda-47d2-b955-d2c5830ac03f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoweczUm {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoweczUm" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dc482d-bd6d-4fa4-8bb0-5c19c89cd375]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoweczUm'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a26159-f60e-4edf-b8e2-982252d47e82]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56a27a4-93ec-4186-9b87-2a36859fdd14]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:56 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:56 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e215c38-631b-489e-a618-aceca1acaa87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260]
Oct 30 11:03:56 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260] successful.
Oct 30 11:03:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d46cd25-3f4c-4a8d-92db-9895989187e8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[031995b6-d202-4c70-93d4-9caeb32ccec9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:56 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:56 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:03:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:03:56 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:03:56 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:03:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e421608-4811-4db8-a5e0-4b1d7c5dc583]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:03:56 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoweczUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26561653762386162', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561653762386162', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-271667642',display_name='tempest-ServerActionsTestOtherA-server-2045755829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-271667642',id=27,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD4PHb/9XzyvWLBbPO6wny4wEPuXFI3gaSrqSdwmjCZkbsuAHJH7SKFqW6FChsnRgIXFl9df68Jt5kVrUhD4iFw8HDLHHScd2I9aHIHob65iYrnC7ObhbXR1SqG3E6kOA==',key_name='tempest-keypair-433171770',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-5otvhosk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:03:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=e94c4f7c-6e99-4694-84d6-ed62c385a4f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:03:57 user nova-compute[74278]:   <uuid>e94c4f7c-6e99-4694-84d6-ed62c385a4f9</uuid>
Oct 30 11:03:57 user nova-compute[74278]:   <name>instance-0000001b</name>
Oct 30 11:03:57 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:03:57 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:03:57 user nova-compute[74278]:   <metadata>
Oct 30 11:03:57 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:03:57 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:03:57 user nova-compute[74278]:       <nova:name>tempest-ServerActionsTestOtherA-server-2045755829</nova:name>
Oct 30 11:03:57 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:03:56</nova:creationTime>
Oct 30 11:03:57 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:03:57 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:03:57 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:03:57 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:03:57 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:03:57 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:03:57 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:03:57 user nova-compute[74278]:       <nova:owner>
Oct 30 11:03:57 user nova-compute[74278]:         <nova:user uuid="1b9a38bd9c4e4717b9499ed404ed2d6d">tempest-ServerActionsTestOtherA-1217247754-project-member</nova:user>
Oct 30 11:03:57 user nova-compute[74278]:         <nova:project uuid="d8215346d10443799d5d450114b09386">tempest-ServerActionsTestOtherA-1217247754</nova:project>
Oct 30 11:03:57 user nova-compute[74278]:       </nova:owner>
Oct 30 11:03:57 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:03:57 user nova-compute[74278]:       <nova:ports>
Oct 30 11:03:57 user nova-compute[74278]:         <nova:port uuid="d0cd08c8-6f28-46d3-a6ad-c2b65ef16803">
Oct 30 11:03:57 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 11:03:57 user nova-compute[74278]:         </nova:port>
Oct 30 11:03:57 user nova-compute[74278]:       </nova:ports>
Oct 30 11:03:57 user nova-compute[74278]:     </nova:instance>
Oct 30 11:03:57 user nova-compute[74278]:   </metadata>
Oct 30 11:03:57 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:03:57 user nova-compute[74278]:     <system>
Oct 30 11:03:57 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:03:57 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:03:57 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:03:57 user nova-compute[74278]:       <entry name="serial">e94c4f7c-6e99-4694-84d6-ed62c385a4f9</entry>
Oct 30 11:03:57 user nova-compute[74278]:       <entry name="uuid">e94c4f7c-6e99-4694-84d6-ed62c385a4f9</entry>
Oct 30 11:03:57 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:03:57 user nova-compute[74278]:     </system>
Oct 30 11:03:57 user nova-compute[74278]:   </sysinfo>
Oct 30 11:03:57 user nova-compute[74278]:   <os>
Oct 30 11:03:57 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:03:57 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:03:57 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:03:57 user nova-compute[74278]:   </os>
Oct 30 11:03:57 user nova-compute[74278]:   <features>
Oct 30 11:03:57 user nova-compute[74278]:     <acpi/>
Oct 30 11:03:57 user nova-compute[74278]:     <apic/>
Oct 30 11:03:57 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:03:57 user nova-compute[74278]:   </features>
Oct 30 11:03:57 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:03:57 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:03:57 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:03:57 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:03:57 user nova-compute[74278]:   </clock>
Oct 30 11:03:57 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:03:57 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:03:57 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:03:57 user nova-compute[74278]:   </cpu>
Oct 30 11:03:57 user nova-compute[74278]:   <devices>
Oct 30 11:03:57 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:03:57 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:03:57 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk"/>
Oct 30 11:03:57 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:03:57 user nova-compute[74278]:     </disk>
Oct 30 11:03:57 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:03:57 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:03:57 user nova-compute[74278]:       <source dev="/dev/sdb"/>
Oct 30 11:03:57 user nova-compute[74278]:       <target dev="vdb" bus="virtio"/>
Oct 30 11:03:57 user nova-compute[74278]:       <serial>5feb7441-95f8-4d76-a055-1bd22f0678f2</serial>
Oct 30 11:03:57 user nova-compute[74278]:     </disk>
Oct 30 11:03:57 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:03:57 user nova-compute[74278]:       <mac address="fa:16:3e:f9:3c:94"/>
Oct 30 11:03:57 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:03:57 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:03:57 user nova-compute[74278]:       <target dev="tapd0cd08c8-6f"/>
Oct 30 11:03:57 user nova-compute[74278]:     </interface>
Oct 30 11:03:57 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:03:57 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/console.log" append="off"/>
Oct 30 11:03:57 user nova-compute[74278]:     </serial>
Oct 30 11:03:57 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:03:57 user nova-compute[74278]:     <video>
Oct 30 11:03:57 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:03:57 user nova-compute[74278]:     </video>
Oct 30 11:03:57 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:03:57 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:03:57 user nova-compute[74278]:     </rng>
Oct 30 11:03:57 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:03:57 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:03:57 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:03:57 user nova-compute[74278]:     </memballoon>
Oct 30 11:03:57 user nova-compute[74278]:   </devices>
Oct 30 11:03:57 user nova-compute[74278]: </domain>
Oct 30 11:03:57 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-271667642',display_name='tempest-ServerActionsTestOtherA-server-2045755829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-271667642',id=27,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD4PHb/9XzyvWLBbPO6wny4wEPuXFI3gaSrqSdwmjCZkbsuAHJH7SKFqW6FChsnRgIXFl9df68Jt5kVrUhD4iFw8HDLHHScd2I9aHIHob65iYrnC7ObhbXR1SqG3E6kOA==',key_name='tempest-keypair-433171770',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:01:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-5otvhosk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:03:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=e94c4f7c-6e99-4694-84d6-ed62c385a4f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG os_vif [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0978a9d8-486e-5bf3-96f8-50ca4dc5b4ee', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0cd08c8-6f, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd0cd08c8-6f, col_values=(('qos', UUID('a2cb3fb7-0bba-406d-a195-19dc164ffe5c')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd0cd08c8-6f, col_values=(('external_ids', {'iface-id': 'd0cd08c8-6f28-46d3-a6ad-c2b65ef16803', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:3c:94', 'vm-uuid': 'e94c4f7c-6e99-4694-84d6-ed62c385a4f9'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:57 user nova-compute[74278]: INFO os_vif [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f')
Oct 30 11:03:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:03:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No VIF found with MAC fa:16:3e:f9:3c:94, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:03:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:03:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-4f162269-7d47-4388-a325-dbfcf7a92b83 req-5e0c331f-f97f-4980-b719-6194401b13f0 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:03:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4f162269-7d47-4388-a325-dbfcf7a92b83 req-5e0c331f-f97f-4980-b719-6194401b13f0 service nova] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:03:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4f162269-7d47-4388-a325-dbfcf7a92b83 req-5e0c331f-f97f-4980-b719-6194401b13f0 service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:03:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4f162269-7d47-4388-a325-dbfcf7a92b83 req-5e0c331f-f97f-4980-b719-6194401b13f0 service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:03:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-4f162269-7d47-4388-a325-dbfcf7a92b83 req-5e0c331f-f97f-4980-b719-6194401b13f0 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] No waiting events found dispatching network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:03:59 user nova-compute[74278]: WARNING nova.compute.manager [req-4f162269-7d47-4388-a325-dbfcf7a92b83 req-5e0c331f-f97f-4980-b719-6194401b13f0 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received unexpected event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 for instance with vm_state active and task_state rebuild_spawning.
Oct 30 11:03:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:04:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Instance spawned successfully.
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-eafb0ff5-2032-4aad-b5d2-eb82f94659a1 req-851a4274-08ad-4db1-8c42-e66067499a22 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eafb0ff5-2032-4aad-b5d2-eb82f94659a1 req-851a4274-08ad-4db1-8c42-e66067499a22 service nova] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eafb0ff5-2032-4aad-b5d2-eb82f94659a1 req-851a4274-08ad-4db1-8c42-e66067499a22 service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eafb0ff5-2032-4aad-b5d2-eb82f94659a1 req-851a4274-08ad-4db1-8c42-e66067499a22 service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-eafb0ff5-2032-4aad-b5d2-eb82f94659a1 req-851a4274-08ad-4db1-8c42-e66067499a22 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] No waiting events found dispatching network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:04:01 user nova-compute[74278]: WARNING nova.compute.manager [req-eafb0ff5-2032-4aad-b5d2-eb82f94659a1 req-851a4274-08ad-4db1-8c42-e66067499a22 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received unexpected event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 for instance with vm_state active and task_state rebuild_spawning.
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74278) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Oct 30 11:04:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a14e119-4b55-4354-b929-78c4ddd1d477 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.082s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:04:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Creating image(s)
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Ensure instance console log exists: /opt/stack/data/nova/instances/3d76b06b-9009-4879-83f4-819b1d20ce6c/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Start _get_guest_xml network_info=[{"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWlZnusY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d76b06b-9009-4879-83f4-819b1d20ce6c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 'serial': 'c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce'}, 'attachment_id': 'a66d7adf-f320-4c53-b4a1-644a9cf9ffcc', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:04:04 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 30 11:04:04 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d76b06b-9009-4879-83f4-819b1d20ce6c {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWlZnusY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:04:04 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:04:04 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:04:04 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a9f418-32f5-453d-990a-27ac3af7a89c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:04:04 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6646b853-2c68-4952-8896-abb60c62cd6c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce] added
Oct 30 11:04:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[746a9b35-4db0-4124-9d6b-19c4b4988da1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1e2665-5a24-4fa5-b3b7-fa7abfadd543]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWlZnusY {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWlZnusY" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa434456-ec9c-4751-902f-b454bbef0e25]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eWlZnusY'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2be6c9-4770-4972-aab4-b7f5a176a6aa]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[81310618-6153-4e7e-b43b-da2928f55834]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:04:04 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:04:04 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:04:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:04:04 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:04:04 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:04:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d049ee8e-8f6e-4298-ba79-45d8286fb167]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260]
Oct 30 11:04:04 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260] successful.
Oct 30 11:04:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf9269b-0066-40e3-a534-0c12138eccca]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedb5de5-4999-40d4-989e-3b9b07dfb686]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:04:04 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:04:04 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:04:04 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:04:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:04:04 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:04:04 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:04:04 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:04:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba3f62d-0303-4ba1-9bf9-6d86200c8e0f]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:04:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWlZnusY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26230616432656238', 'path': '/dev/sdd'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230616432656238', 'path': '/dev/sdd'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-248564876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1641223937',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHVmrqblopLInY1Wvk20+mn5oY9HK3qJoDsTdzD86gNKR60O24Sw37vqqe1SrB61PQcGQ4FQ4hLz1IfnqJniiFuJlMlaNcPIwOFFcbpXS/Op3g50/gRu7VGHSf0Wg5YEw==',key_name='tempest-keypair-1295466818',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0e2c85eda9534f06bd5d7db1300d1f73',ramdisk_id='',reservation_id='r-mt0ozl4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-632878584',owner_user_name='tempest-ServerActionsV293TestJSON-632878584-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e7bb5f85c254f3d9febe9dc037a8459',uuid=3d76b06b-9009-4879-83f4-819b1d20ce6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Converting VIF {"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:04:05 user nova-compute[74278]:   <uuid>3d76b06b-9009-4879-83f4-819b1d20ce6c</uuid>
Oct 30 11:04:05 user nova-compute[74278]:   <name>instance-0000001a</name>
Oct 30 11:04:05 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:04:05 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:04:05 user nova-compute[74278]:   <metadata>
Oct 30 11:04:05 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:04:05 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:04:05 user nova-compute[74278]:       <nova:name>tempest-ServerActionsV293TestJSON-server-248564876</nova:name>
Oct 30 11:04:05 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:04:04</nova:creationTime>
Oct 30 11:04:05 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:04:05 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:04:05 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:04:05 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:04:05 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:04:05 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:04:05 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:04:05 user nova-compute[74278]:       <nova:owner>
Oct 30 11:04:05 user nova-compute[74278]:         <nova:user uuid="6e7bb5f85c254f3d9febe9dc037a8459">tempest-ServerActionsV293TestJSON-632878584-project-member</nova:user>
Oct 30 11:04:05 user nova-compute[74278]:         <nova:project uuid="0e2c85eda9534f06bd5d7db1300d1f73">tempest-ServerActionsV293TestJSON-632878584</nova:project>
Oct 30 11:04:05 user nova-compute[74278]:       </nova:owner>
Oct 30 11:04:05 user nova-compute[74278]:       <nova:ports>
Oct 30 11:04:05 user nova-compute[74278]:         <nova:port uuid="8fac0256-08e9-4391-9b63-41b420e15539">
Oct 30 11:04:05 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 11:04:05 user nova-compute[74278]:         </nova:port>
Oct 30 11:04:05 user nova-compute[74278]:       </nova:ports>
Oct 30 11:04:05 user nova-compute[74278]:     </nova:instance>
Oct 30 11:04:05 user nova-compute[74278]:   </metadata>
Oct 30 11:04:05 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:04:05 user nova-compute[74278]:     <system>
Oct 30 11:04:05 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:04:05 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:04:05 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:04:05 user nova-compute[74278]:       <entry name="serial">3d76b06b-9009-4879-83f4-819b1d20ce6c</entry>
Oct 30 11:04:05 user nova-compute[74278]:       <entry name="uuid">3d76b06b-9009-4879-83f4-819b1d20ce6c</entry>
Oct 30 11:04:05 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:04:05 user nova-compute[74278]:     </system>
Oct 30 11:04:05 user nova-compute[74278]:   </sysinfo>
Oct 30 11:04:05 user nova-compute[74278]:   <os>
Oct 30 11:04:05 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:04:05 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:04:05 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:04:05 user nova-compute[74278]:   </os>
Oct 30 11:04:05 user nova-compute[74278]:   <features>
Oct 30 11:04:05 user nova-compute[74278]:     <acpi/>
Oct 30 11:04:05 user nova-compute[74278]:     <apic/>
Oct 30 11:04:05 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:04:05 user nova-compute[74278]:   </features>
Oct 30 11:04:05 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:04:05 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:04:05 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:04:05 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:04:05 user nova-compute[74278]:   </clock>
Oct 30 11:04:05 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:04:05 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:04:05 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:04:05 user nova-compute[74278]:   </cpu>
Oct 30 11:04:05 user nova-compute[74278]:   <devices>
Oct 30 11:04:05 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:04:05 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:04:05 user nova-compute[74278]:       <source dev="/dev/sdd"/>
Oct 30 11:04:05 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:04:05 user nova-compute[74278]:       <serial>c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce</serial>
Oct 30 11:04:05 user nova-compute[74278]:     </disk>
Oct 30 11:04:05 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:04:05 user nova-compute[74278]:       <mac address="fa:16:3e:9c:e3:8e"/>
Oct 30 11:04:05 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:04:05 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:04:05 user nova-compute[74278]:       <target dev="tap8fac0256-08"/>
Oct 30 11:04:05 user nova-compute[74278]:     </interface>
Oct 30 11:04:05 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:04:05 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/3d76b06b-9009-4879-83f4-819b1d20ce6c/console.log" append="off"/>
Oct 30 11:04:05 user nova-compute[74278]:     </serial>
Oct 30 11:04:05 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:04:05 user nova-compute[74278]:     <video>
Oct 30 11:04:05 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:04:05 user nova-compute[74278]:     </video>
Oct 30 11:04:05 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:04:05 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:04:05 user nova-compute[74278]:     </rng>
Oct 30 11:04:05 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:04:05 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:04:05 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:04:05 user nova-compute[74278]:     </memballoon>
Oct 30 11:04:05 user nova-compute[74278]:   </devices>
Oct 30 11:04:05 user nova-compute[74278]: </domain>
Oct 30 11:04:05 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-248564876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1641223937',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHVmrqblopLInY1Wvk20+mn5oY9HK3qJoDsTdzD86gNKR60O24Sw37vqqe1SrB61PQcGQ4FQ4hLz1IfnqJniiFuJlMlaNcPIwOFFcbpXS/Op3g50/gRu7VGHSf0Wg5YEw==',key_name='tempest-keypair-1295466818',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0e2c85eda9534f06bd5d7db1300d1f73',ramdisk_id='',reservation_id='r-mt0ozl4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-632878584',owner_user_name='tempest-ServerActionsV293TestJSON-632878584-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e7bb5f85c254f3d9febe9dc037a8459',uuid=3d76b06b-9009-4879-83f4-819b1d20ce6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Converting VIF {"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG os_vif [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08f857d6-d2f8-5fae-9a95-de41a7fe3762', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fac0256-08, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fac0256-08, col_values=(('qos', UUID('714e0555-7eca-4e7c-ae54-37fd8aedebd6')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fac0256-08, col_values=(('external_ids', {'iface-id': '8fac0256-08e9-4391-9b63-41b420e15539', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:e3:8e', 'vm-uuid': '3d76b06b-9009-4879-83f4-819b1d20ce6c'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:05 user nova-compute[74278]: INFO os_vif [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08')
Oct 30 11:04:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:04:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] No VIF found with MAC fa:16:3e:9c:e3:8e, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:04:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-5f97323e-b8a9-4e82-9a1e-a810a8f5443d req-5dc50f27-afee-407f-9434-64fcbed1d530 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5f97323e-b8a9-4e82-9a1e-a810a8f5443d req-5dc50f27-afee-407f-9434-64fcbed1d530 service nova] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5f97323e-b8a9-4e82-9a1e-a810a8f5443d req-5dc50f27-afee-407f-9434-64fcbed1d530 service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5f97323e-b8a9-4e82-9a1e-a810a8f5443d req-5dc50f27-afee-407f-9434-64fcbed1d530 service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-5f97323e-b8a9-4e82-9a1e-a810a8f5443d req-5dc50f27-afee-407f-9434-64fcbed1d530 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] No waiting events found dispatching network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:04:07 user nova-compute[74278]: WARNING nova.compute.manager [req-5f97323e-b8a9-4e82-9a1e-a810a8f5443d req-5dc50f27-afee-407f-9434-64fcbed1d530 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received unexpected event network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 for instance with vm_state active and task_state rebuild_spawning.
Oct 30 11:04:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-04b9a3b1-55d1-4a6b-9689-268071350181 req-42660b15-c512-4e18-9b42-c299b6a87232 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-04b9a3b1-55d1-4a6b-9689-268071350181 req-42660b15-c512-4e18-9b42-c299b6a87232 service nova] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-04b9a3b1-55d1-4a6b-9689-268071350181 req-42660b15-c512-4e18-9b42-c299b6a87232 service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-04b9a3b1-55d1-4a6b-9689-268071350181 req-42660b15-c512-4e18-9b42-c299b6a87232 service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-04b9a3b1-55d1-4a6b-9689-268071350181 req-42660b15-c512-4e18-9b42-c299b6a87232 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] No waiting events found dispatching network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:04:09 user nova-compute[74278]: WARNING nova.compute.manager [req-04b9a3b1-55d1-4a6b-9689-268071350181 req-42660b15-c512-4e18-9b42-c299b6a87232 service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received unexpected event network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 for instance with vm_state active and task_state rebuild_spawning.
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:04:09 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Instance spawned successfully.
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74278) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPmQZzEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:04:09 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:04:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:04:09 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:04:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:04:09 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05b18af-dd48-42b5-b31f-be884ab67501]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:04:09 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.039s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1c7690f0-b1e8-4ef9-ba38-3b5404c867ba tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.114s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29dd491-b1e9-480c-b686-ab6174b43116]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f] added
Oct 30 11:04:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6d1ab5-b516-4368-9b54-a54c1576cb77]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4908c8f7-c1e3-4a4b-a2e2-06897292fe7f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPmQZzEL {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPmQZzEL" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[54222730-c598-4805-9980-d75038b47a19]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VPmQZzEL'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c9b6e1-b33a-4999-bca6-d4ea18f6eef9]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bc739e-9e0a-4bfa-807b-7dcaa233b556]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:04:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:04:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --login" returned: 0 in 0.117s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e30d096-1900-4341-9c03-cab1bde51a2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f, portal: 172.16.0.220,3260]
Oct 30 11:04:10 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f, portal: 172.16.0.220,3260] successful.
Oct 30 11:04:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[381b27e8-4eaf-489f-8616-b2dc5449be90]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ac9614-61f1-4b0b-963f-699f35b7ecb9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f (non-flash)
Oct 30 11:04:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:04:10 user nova-compute[74278]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f (non-flash)
Oct 30 11:04:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.438s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a91214-9a3b-4e99-b025-a94863122d5e]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPmQZzEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:04:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.497s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:04:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] <== connect_volume: return (1499ms) {'type': 'block', 'scsi_wwn': '26337636331336237', 'path': '/dev/sde'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:04:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337636331336237', 'path': '/dev/sde'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:04:11 user nova-compute[74278]: DEBUG nova.objects.instance [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'flavor' on Instance uuid ef2b0994-a1be-49f5-8617-7fedfeaeca6c {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:04:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:04:11 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:04:11 user nova-compute[74278]:   <source dev="/dev/sde"/>
Oct 30 11:04:11 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:04:11 user nova-compute[74278]:   <serial>813a3d71-058d-46e5-8e1d-e2056808db3f</serial>
Oct 30 11:04:11 user nova-compute[74278]: </disk>
Oct 30 11:04:11 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:04:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:04:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:04:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] No VIF found with MAC fa:16:3e:59:0c:4c, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:04:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-82b5f3b8-bad4-47e3-840c-edad454a6b58 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.398s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:13 user nova-compute[74278]: INFO nova.compute.manager [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Detaching volume 813a3d71-058d-46e5-8e1d-e2056808db3f
Oct 30 11:04:13 user nova-compute[74278]: INFO nova.virt.block_device [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Attempting to driver detach volume 813a3d71-058d-46e5-8e1d-e2056808db3f from mountpoint /dev/vdb
Oct 30 11:04:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Attempting to detach device vdb from instance ef2b0994-a1be-49f5-8617-7fedfeaeca6c from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:04:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:04:13 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:04:13 user nova-compute[74278]:   <source dev="/dev/sde"/>
Oct 30 11:04:13 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:04:13 user nova-compute[74278]:   <serial>813a3d71-058d-46e5-8e1d-e2056808db3f</serial>
Oct 30 11:04:13 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:04:13 user nova-compute[74278]: </disk>
Oct 30 11:04:13 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:04:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully detached device vdb from instance ef2b0994-a1be-49f5-8617-7fedfeaeca6c from the persistent domain config.
Oct 30 11:04:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ef2b0994-a1be-49f5-8617-7fedfeaeca6c from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:04:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:04:13 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:04:13 user nova-compute[74278]:   <source dev="/dev/sde"/>
Oct 30 11:04:13 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:04:13 user nova-compute[74278]:   <serial>813a3d71-058d-46e5-8e1d-e2056808db3f</serial>
Oct 30 11:04:13 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:04:13 user nova-compute[74278]: </disk>
Oct 30 11:04:13 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:04:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ef2b0994-a1be-49f5-8617-7fedfeaeca6c {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:04:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:23 user nova-compute[74278]: INFO nova.compute.manager [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Terminating instance
Oct 30 11:04:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Instance destroyed successfully.
Oct 30 11:04:23 user nova-compute[74278]: DEBUG nova.objects.instance [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'resources' on Instance uuid 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1903672377',display_name='tempest-AttachVolumeTestJSON-server-1903672377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1903672377',id=14,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLw2A/RWC5+R4btriIoM9znu/g01+rQRK1t+3KnEGqXbGVndP3w3zXUjxA1EkRr8FgR+n/Ic2QTQuO6qPRQc5lNQ8uEvxmMbEmYIWKtUXYn+0cTj5aRqBB0fgw9nPXA5Dg==',key_name='tempest-keypair-1025364301',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:54:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='928164ecd5c44dddb93fbecfeaa44071',ramdisk_id='',reservation_id='r-o9r3qvit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2116287848',owner_user_name='tempest-AttachVolumeTestJSON-2116287848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='525f98e0bed241fdad3962fda627b143',uuid=00dd2fe2-a888-44a1-9dfd-ad72acd03cfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converting VIF {"id": "c2c68f43-b884-4bf0-8948-447c35ce1402", "address": "fa:16:3e:86:86:a1", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2c68f43-b8", "ovs_interfaceid": "c2c68f43-b884-4bf0-8948-447c35ce1402", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG os_vif [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2c68f43-b8, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f464292-c5d0-4f3c-9852-f93acf1f8f3a) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:04:23 user nova-compute[74278]: INFO os_vif [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:86:a1,bridge_name='br-int',has_traffic_filtering=True,id=c2c68f43-b884-4bf0-8948-447c35ce1402,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2c68f43-b8')
Oct 30 11:04:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Deleting instance files /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa_del
Oct 30 11:04:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Deletion of /opt/stack/data/nova/instances/00dd2fe2-a888-44a1-9dfd-ad72acd03cfa_del complete
Oct 30 11:04:23 user nova-compute[74278]: INFO nova.compute.manager [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 30 11:04:23 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:04:23 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:04:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:04:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:24 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:04:24 user nova-compute[74278]: INFO nova.compute.claims [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Claim successful on node user
Oct 30 11:04:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:24 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:04:24 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Took 0.95 seconds to deallocate network for instance.
Oct 30 11:04:24 user nova-compute[74278]: DEBUG nova.compute.manager [req-a214ce1f-6ee5-4409-8abc-4c68d5eb8f27 req-84097adf-b9db-4eab-a38d-831d61660a0d service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Received event network-vif-deleted-c2c68f43-b884-4bf0-8948-447c35ce1402 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:24 user nova-compute[74278]: INFO nova.compute.manager [req-a214ce1f-6ee5-4409-8abc-4c68d5eb8f27 req-84097adf-b9db-4eab-a38d-831d61660a0d service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Neutron deleted interface c2c68f43-b884-4bf0-8948-447c35ce1402; detaching it from the instance and deleting it from the info cache
Oct 30 11:04:24 user nova-compute[74278]: DEBUG nova.network.neutron [req-a214ce1f-6ee5-4409-8abc-4c68d5eb8f27 req-84097adf-b9db-4eab-a38d-831d61660a0d service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:04:24 user nova-compute[74278]: DEBUG nova.compute.manager [req-a214ce1f-6ee5-4409-8abc-4c68d5eb8f27 req-84097adf-b9db-4eab-a38d-831d61660a0d service nova] [instance: 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa] Detach interface failed, port_id=c2c68f43-b884-4bf0-8948-447c35ce1402, reason: Instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.535s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.128s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:04:25 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:04:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG nova.policy [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20d49847983f430a86128dee0046385f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f53b83164364a24a93f397e578d1ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:04:25 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Creating image(s)
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "/opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "/opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "/opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:25 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Deleted allocations for instance 00dd2fe2-a888-44a1-9dfd-ad72acd03cfa
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.257s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c5d0bc5b-7fab-4585-a0cd-bd199e2e2f4b tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "00dd2fe2-a888-44a1-9dfd-ad72acd03cfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.831s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk 1073741824" returned: 0 in 0.068s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:26 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:04:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:26 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Cannot resize image /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:04:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:04:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Ensure instance console log exists: /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:04:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Successfully created port: 333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Successfully updated port: 333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "refresh_cache-f35f1e59-504e-42d2-9d50-f14a32844bdb" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquired lock "refresh_cache-f35f1e59-504e-42d2-9d50-f14a32844bdb" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-a4e63084-0480-4914-b4d4-ebf23ba02873 req-43cd9a92-baa0-4571-95b4-b7a27fa65525 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Received event network-changed-333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-a4e63084-0480-4914-b4d4-ebf23ba02873 req-43cd9a92-baa0-4571-95b4-b7a27fa65525 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Refreshing instance network info cache due to event network-changed-333767b9-356d-47ab-a72e-6ef22262c57f. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a4e63084-0480-4914-b4d4-ebf23ba02873 req-43cd9a92-baa0-4571-95b4-b7a27fa65525 service nova] Acquiring lock "refresh_cache-f35f1e59-504e-42d2-9d50-f14a32844bdb" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Updating instance_info_cache with network_info: [{"id": "333767b9-356d-47ab-a72e-6ef22262c57f", "address": "fa:16:3e:6f:fb:3d", "network": {"id": "4bcb592e-43df-4f4a-bb74-03b24c1795ef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1818877804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f53b83164364a24a93f397e578d1ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333767b9-35", "ovs_interfaceid": "333767b9-356d-47ab-a72e-6ef22262c57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Releasing lock "refresh_cache-f35f1e59-504e-42d2-9d50-f14a32844bdb" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Instance network_info: |[{"id": "333767b9-356d-47ab-a72e-6ef22262c57f", "address": "fa:16:3e:6f:fb:3d", "network": {"id": "4bcb592e-43df-4f4a-bb74-03b24c1795ef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1818877804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f53b83164364a24a93f397e578d1ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333767b9-35", "ovs_interfaceid": "333767b9-356d-47ab-a72e-6ef22262c57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a4e63084-0480-4914-b4d4-ebf23ba02873 req-43cd9a92-baa0-4571-95b4-b7a27fa65525 service nova] Acquired lock "refresh_cache-f35f1e59-504e-42d2-9d50-f14a32844bdb" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.network.neutron [req-a4e63084-0480-4914-b4d4-ebf23ba02873 req-43cd9a92-baa0-4571-95b4-b7a27fa65525 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Refreshing network info cache for port 333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Start _get_guest_xml network_info=[{"id": "333767b9-356d-47ab-a72e-6ef22262c57f", "address": "fa:16:3e:6f:fb:3d", "network": {"id": "4bcb592e-43df-4f4a-bb74-03b24c1795ef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1818877804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f53b83164364a24a93f397e578d1ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333767b9-35", "ovs_interfaceid": "333767b9-356d-47ab-a72e-6ef22262c57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:04:27 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:04:27 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-233606836',display_name='tempest-TestServerVolumeAttachmentScenario-server-233606836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-233606836',id=32,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwjfSBawd3W8neyYy5JeGS6/9+toBHTZU5JnOYq2WL2j69DiLBbUzUuaS67uxNqlhR00xozPYjlduNMlOsqnzoW1Ct+UrMTlreUILwRIadtQQKYWthzJFpY+jcAU3XKYQ==',key_name='tempest-keypair-419545702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f53b83164364a24a93f397e578d1ad8',ramdisk_id='',reservation_id='r-67is2ysi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1265312722',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1265312722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20d49847983f430a86128dee0046385f',uuid=f35f1e59-504e-42d2-9d50-f14a32844bdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "333767b9-356d-47ab-a72e-6ef22262c57f", "address": "fa:16:3e:6f:fb:3d", "network": {"id": "4bcb592e-43df-4f4a-bb74-03b24c1795ef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1818877804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f53b83164364a24a93f397e578d1ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333767b9-35", "ovs_interfaceid": "333767b9-356d-47ab-a72e-6ef22262c57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Converting VIF {"id": "333767b9-356d-47ab-a72e-6ef22262c57f", "address": "fa:16:3e:6f:fb:3d", "network": {"id": "4bcb592e-43df-4f4a-bb74-03b24c1795ef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1818877804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f53b83164364a24a93f397e578d1ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333767b9-35", "ovs_interfaceid": "333767b9-356d-47ab-a72e-6ef22262c57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:fb:3d,bridge_name='br-int',has_traffic_filtering=True,id=333767b9-356d-47ab-a72e-6ef22262c57f,network=Network(4bcb592e-43df-4f4a-bb74-03b24c1795ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333767b9-35') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.objects.instance [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lazy-loading 'pci_devices' on Instance uuid f35f1e59-504e-42d2-9d50-f14a32844bdb {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:04:27 user nova-compute[74278]:   <uuid>f35f1e59-504e-42d2-9d50-f14a32844bdb</uuid>
Oct 30 11:04:27 user nova-compute[74278]:   <name>instance-00000020</name>
Oct 30 11:04:27 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:04:27 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:04:27 user nova-compute[74278]:   <metadata>
Oct 30 11:04:27 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:04:27 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:04:27 user nova-compute[74278]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-233606836</nova:name>
Oct 30 11:04:27 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:04:27</nova:creationTime>
Oct 30 11:04:27 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:04:27 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:04:27 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:04:27 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:04:27 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:04:27 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:04:27 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:04:27 user nova-compute[74278]:       <nova:owner>
Oct 30 11:04:27 user nova-compute[74278]:         <nova:user uuid="20d49847983f430a86128dee0046385f">tempest-TestServerVolumeAttachmentScenario-1265312722-project-member</nova:user>
Oct 30 11:04:27 user nova-compute[74278]:         <nova:project uuid="4f53b83164364a24a93f397e578d1ad8">tempest-TestServerVolumeAttachmentScenario-1265312722</nova:project>
Oct 30 11:04:27 user nova-compute[74278]:       </nova:owner>
Oct 30 11:04:27 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:04:27 user nova-compute[74278]:       <nova:ports>
Oct 30 11:04:27 user nova-compute[74278]:         <nova:port uuid="333767b9-356d-47ab-a72e-6ef22262c57f">
Oct 30 11:04:27 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 11:04:27 user nova-compute[74278]:         </nova:port>
Oct 30 11:04:27 user nova-compute[74278]:       </nova:ports>
Oct 30 11:04:27 user nova-compute[74278]:     </nova:instance>
Oct 30 11:04:27 user nova-compute[74278]:   </metadata>
Oct 30 11:04:27 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:04:27 user nova-compute[74278]:     <system>
Oct 30 11:04:27 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:04:27 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:04:27 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:04:27 user nova-compute[74278]:       <entry name="serial">f35f1e59-504e-42d2-9d50-f14a32844bdb</entry>
Oct 30 11:04:27 user nova-compute[74278]:       <entry name="uuid">f35f1e59-504e-42d2-9d50-f14a32844bdb</entry>
Oct 30 11:04:27 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:04:27 user nova-compute[74278]:     </system>
Oct 30 11:04:27 user nova-compute[74278]:   </sysinfo>
Oct 30 11:04:27 user nova-compute[74278]:   <os>
Oct 30 11:04:27 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:04:27 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:04:27 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:04:27 user nova-compute[74278]:   </os>
Oct 30 11:04:27 user nova-compute[74278]:   <features>
Oct 30 11:04:27 user nova-compute[74278]:     <acpi/>
Oct 30 11:04:27 user nova-compute[74278]:     <apic/>
Oct 30 11:04:27 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:04:27 user nova-compute[74278]:   </features>
Oct 30 11:04:27 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:04:27 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:04:27 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:04:27 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:04:27 user nova-compute[74278]:   </clock>
Oct 30 11:04:27 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:04:27 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:04:27 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:04:27 user nova-compute[74278]:   </cpu>
Oct 30 11:04:27 user nova-compute[74278]:   <devices>
Oct 30 11:04:27 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:04:27 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:04:27 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk"/>
Oct 30 11:04:27 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:04:27 user nova-compute[74278]:     </disk>
Oct 30 11:04:27 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:04:27 user nova-compute[74278]:       <mac address="fa:16:3e:6f:fb:3d"/>
Oct 30 11:04:27 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:04:27 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:04:27 user nova-compute[74278]:       <target dev="tap333767b9-35"/>
Oct 30 11:04:27 user nova-compute[74278]:     </interface>
Oct 30 11:04:27 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:04:27 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/console.log" append="off"/>
Oct 30 11:04:27 user nova-compute[74278]:     </serial>
Oct 30 11:04:27 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:04:27 user nova-compute[74278]:     <video>
Oct 30 11:04:27 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:04:27 user nova-compute[74278]:     </video>
Oct 30 11:04:27 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:04:27 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:04:27 user nova-compute[74278]:     </rng>
Oct 30 11:04:27 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:04:27 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:04:27 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:04:27 user nova-compute[74278]:     </memballoon>
Oct 30 11:04:27 user nova-compute[74278]:   </devices>
Oct 30 11:04:27 user nova-compute[74278]: </domain>
Oct 30 11:04:27 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-233606836',display_name='tempest-TestServerVolumeAttachmentScenario-server-233606836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-233606836',id=32,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwjfSBawd3W8neyYy5JeGS6/9+toBHTZU5JnOYq2WL2j69DiLBbUzUuaS67uxNqlhR00xozPYjlduNMlOsqnzoW1Ct+UrMTlreUILwRIadtQQKYWthzJFpY+jcAU3XKYQ==',key_name='tempest-keypair-419545702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f53b83164364a24a93f397e578d1ad8',ramdisk_id='',reservation_id='r-67is2ysi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1265312722',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1265312722-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20d49847983f430a86128dee0046385f',uuid=f35f1e59-504e-42d2-9d50-f14a32844bdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "333767b9-356d-47ab-a72e-6ef22262c57f", "address": "fa:16:3e:6f:fb:3d", "network": {"id": "4bcb592e-43df-4f4a-bb74-03b24c1795ef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1818877804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f53b83164364a24a93f397e578d1ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333767b9-35", "ovs_interfaceid": "333767b9-356d-47ab-a72e-6ef22262c57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Converting VIF {"id": "333767b9-356d-47ab-a72e-6ef22262c57f", "address": "fa:16:3e:6f:fb:3d", "network": {"id": "4bcb592e-43df-4f4a-bb74-03b24c1795ef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1818877804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f53b83164364a24a93f397e578d1ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333767b9-35", "ovs_interfaceid": "333767b9-356d-47ab-a72e-6ef22262c57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:fb:3d,bridge_name='br-int',has_traffic_filtering=True,id=333767b9-356d-47ab-a72e-6ef22262c57f,network=Network(4bcb592e-43df-4f4a-bb74-03b24c1795ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333767b9-35') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG os_vif [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:fb:3d,bridge_name='br-int',has_traffic_filtering=True,id=333767b9-356d-47ab-a72e-6ef22262c57f,network=Network(4bcb592e-43df-4f4a-bb74-03b24c1795ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333767b9-35') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '722bee6b-22a1-5f5a-ad6f-f6ebecdb3b39', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap333767b9-35, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap333767b9-35, col_values=(('qos', UUID('8ee51e9b-ef71-4e28-9f49-b770bd41ddcb')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap333767b9-35, col_values=(('external_ids', {'iface-id': '333767b9-356d-47ab-a72e-6ef22262c57f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:fb:3d', 'vm-uuid': 'f35f1e59-504e-42d2-9d50-f14a32844bdb'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:27 user nova-compute[74278]: INFO os_vif [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:fb:3d,bridge_name='br-int',has_traffic_filtering=True,id=333767b9-356d-47ab-a72e-6ef22262c57f,network=Network(4bcb592e-43df-4f4a-bb74-03b24c1795ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333767b9-35')
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:04:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] No VIF found with MAC fa:16:3e:6f:fb:3d, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:04:28 user nova-compute[74278]: DEBUG nova.network.neutron [req-a4e63084-0480-4914-b4d4-ebf23ba02873 req-43cd9a92-baa0-4571-95b4-b7a27fa65525 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Updated VIF entry in instance network info cache for port 333767b9-356d-47ab-a72e-6ef22262c57f. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:04:28 user nova-compute[74278]: DEBUG nova.network.neutron [req-a4e63084-0480-4914-b4d4-ebf23ba02873 req-43cd9a92-baa0-4571-95b4-b7a27fa65525 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Updating instance_info_cache with network_info: [{"id": "333767b9-356d-47ab-a72e-6ef22262c57f", "address": "fa:16:3e:6f:fb:3d", "network": {"id": "4bcb592e-43df-4f4a-bb74-03b24c1795ef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1818877804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f53b83164364a24a93f397e578d1ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333767b9-35", "ovs_interfaceid": "333767b9-356d-47ab-a72e-6ef22262c57f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:04:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a4e63084-0480-4914-b4d4-ebf23ba02873 req-43cd9a92-baa0-4571-95b4-b7a27fa65525 service nova] Releasing lock "refresh_cache-f35f1e59-504e-42d2-9d50-f14a32844bdb" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:04:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG nova.compute.manager [req-4854f85f-4b86-45fd-8e00-e688dad36099 req-6909627d-08ed-459f-9481-bd4572cb4997 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Received event network-vif-plugged-333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4854f85f-4b86-45fd-8e00-e688dad36099 req-6909627d-08ed-459f-9481-bd4572cb4997 service nova] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4854f85f-4b86-45fd-8e00-e688dad36099 req-6909627d-08ed-459f-9481-bd4572cb4997 service nova] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4854f85f-4b86-45fd-8e00-e688dad36099 req-6909627d-08ed-459f-9481-bd4572cb4997 service nova] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG nova.compute.manager [req-4854f85f-4b86-45fd-8e00-e688dad36099 req-6909627d-08ed-459f-9481-bd4572cb4997 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] No waiting events found dispatching network-vif-plugged-333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:04:29 user nova-compute[74278]: WARNING nova.compute.manager [req-4854f85f-4b86-45fd-8e00-e688dad36099 req-6909627d-08ed-459f-9481-bd4572cb4997 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Received unexpected event network-vif-plugged-333767b9-356d-47ab-a72e-6ef22262c57f for instance with vm_state building and task_state spawning.
Oct 30 11:04:29 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Didn't find any instances for network info cache update. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:04:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:04:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:30 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:04:31 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Instance spawned successfully.
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.compute.manager [req-73fec1e9-563a-49c6-a470-81ae38e9f604 req-eb68c087-21b2-4db1-aeb9-bf278c79cae5 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Received event network-vif-plugged-333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-73fec1e9-563a-49c6-a470-81ae38e9f604 req-eb68c087-21b2-4db1-aeb9-bf278c79cae5 service nova] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-73fec1e9-563a-49c6-a470-81ae38e9f604 req-eb68c087-21b2-4db1-aeb9-bf278c79cae5 service nova] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-73fec1e9-563a-49c6-a470-81ae38e9f604 req-eb68c087-21b2-4db1-aeb9-bf278c79cae5 service nova] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.compute.manager [req-73fec1e9-563a-49c6-a470-81ae38e9f604 req-eb68c087-21b2-4db1-aeb9-bf278c79cae5 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] No waiting events found dispatching network-vif-plugged-333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:04:31 user nova-compute[74278]: WARNING nova.compute.manager [req-73fec1e9-563a-49c6-a470-81ae38e9f604 req-eb68c087-21b2-4db1-aeb9-bf278c79cae5 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Received unexpected event network-vif-plugged-333767b9-356d-47ab-a72e-6ef22262c57f for instance with vm_state building and task_state spawning.
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:04:31 user nova-compute[74278]: INFO nova.compute.manager [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Took 6.03 seconds to spawn the instance on the hypervisor.
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:31 user nova-compute[74278]: INFO nova.compute.manager [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Took 6.95 seconds to build instance.
Oct 30 11:04:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c1d2ed2c-4c9a-4943-916e-e78296925cf9 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.108s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:04:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:33 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ef2b0994-a1be-49f5-8617-7fedfeaeca6c is timed out.
Oct 30 11:04:33 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully detached device vdb from instance ef2b0994-a1be-49f5-8617-7fedfeaeca6c from the live domain config.
Oct 30 11:04:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPmQZzEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:04:33 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:04:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5c1cf6-4f7a-4a28-91ae-7615218c03aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:04:33 user nova-compute[74278]: No targets found.
Oct 30 11:04:33 user nova-compute[74278]: iSNS:
Oct 30 11:04:33 user nova-compute[74278]: No targets found.
Oct 30 11:04:33 user nova-compute[74278]: STATIC:
Oct 30 11:04:33 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2
Oct 30 11:04:33 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:04:33 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:04:33 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f
Oct 30 11:04:33 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:04:33 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:04:33 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3
Oct 30 11:04:33 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:04:33 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:04:33 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:04:33 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:04:33 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:04:33 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce
Oct 30 11:04:33 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:04:33 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:04:33 user nova-compute[74278]: FIRMWARE:
Oct 30 11:04:33 user nova-compute[74278]: No targets found.
Oct 30 11:04:33 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:04:33 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:04:33 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9376cd9-4d90-4f84-8efa-2c5a1137270a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[446d790b-c114-45e1-b1af-7da6c2dae4bc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:04:33 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:04:33 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:04:33 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:04:33 user nova-compute[74278]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f (non-flash)
Oct 30 11:04:33 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:04:33 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:04:33 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:04:33 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:04:33 user nova-compute[74278]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f (non-flash)
Oct 30 11:04:33 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c117ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f'): ({'sde'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Removing single pathed devices sde {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:04:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff8da63-8111-463c-87d0-0bd6ddfe6051]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d435afef-e0e2-460b-ae83-4371f86d3da8]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Flushing IO for device /dev/sde {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf79ed07-e6fa-406a-85a9-1049cd964e63]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb42175-3a3c-4cec-9566-4e8403cef674]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] SCSI volumes sde have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c68935-2b82-4af2-acf0-c8d8a63d767d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[729f0fd2-39ad-4571-b4f9-a5a632953f22]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f, portal: 172.16.0.220,3260]
Oct 30 11:04:34 user nova-compute[74278]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f, portal: 172.16.0.220,3260] successful.
Oct 30 11:04:34 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:813a3d71-058d-46e5-8e1d-e2056808db3f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b4532e-15ac-4e8c-b0c9-ea5a9efe2ac9]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] <== disconnect_volume: return (390ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.objects.instance [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'flavor' on Instance uuid ef2b0994-a1be-49f5-8617-7fedfeaeca6c {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:04:35 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:04:35 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7237MB free_disk=24.842845916748047GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-51484dfa-5d5b-4265-aa35-dfeb862083d7 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.424s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 64287717-7d3b-4087-aedf-faf87be774a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2b8efca4-cec4-4179-99af-92172f9b8a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 3d76b06b-9009-4879-83f4-819b1d20ce6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance ef2b0994-a1be-49f5-8617-7fedfeaeca6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 6d868c1e-1985-48b6-a881-4d17b364701a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 283358a3-e52d-4019-8d88-8f86d456122f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a30a0e67-5274-4f10-9f88-038dfe0e4fbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance f35f1e59-504e-42d2-9d50-f14a32844bdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:04:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:36 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:04:36 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:04:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:39 user nova-compute[74278]: INFO nova.compute.manager [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Rescuing
Oct 30 11:04:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "refresh_cache-6d868c1e-1985-48b6-a881-4d17b364701a" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:04:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquired lock "refresh_cache-6d868c1e-1985-48b6-a881-4d17b364701a" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:04:39 user nova-compute[74278]: DEBUG nova.network.neutron [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:04:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:39 user nova-compute[74278]: DEBUG nova.network.neutron [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Updating instance_info_cache with network_info: [{"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:04:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Releasing lock "refresh_cache-6d868c1e-1985-48b6-a881-4d17b364701a" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:40 user nova-compute[74278]: INFO nova.compute.manager [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Unshelving
Oct 30 11:04:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:40 user nova-compute[74278]: INFO nova.virt.block_device [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Booting with volume 00a4d066-fc8a-4376-badd-5ed405442e93 at /dev/vdc
Oct 30 11:04:40 user nova-compute[74278]: DEBUG os_brick.utils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG nova.compute.manager [req-8c34b89a-804e-4dbd-8d5b-b4f7af891960 req-1fb7c6ca-3ec3-4e2a-ab80-39d0a39db3f7 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-unplugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c34b89a-804e-4dbd-8d5b-b4f7af891960 req-1fb7c6ca-3ec3-4e2a-ab80-39d0a39db3f7 service nova] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c34b89a-804e-4dbd-8d5b-b4f7af891960 req-1fb7c6ca-3ec3-4e2a-ab80-39d0a39db3f7 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c34b89a-804e-4dbd-8d5b-b4f7af891960 req-1fb7c6ca-3ec3-4e2a-ab80-39d0a39db3f7 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG nova.compute.manager [req-8c34b89a-804e-4dbd-8d5b-b4f7af891960 req-1fb7c6ca-3ec3-4e2a-ab80-39d0a39db3f7 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] No waiting events found dispatching network-vif-unplugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:04:40 user nova-compute[74278]: WARNING nova.compute.manager [req-8c34b89a-804e-4dbd-8d5b-b4f7af891960 req-1fb7c6ca-3ec3-4e2a-ab80-39d0a39db3f7 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received unexpected event network-vif-unplugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b for instance with vm_state active and task_state rescuing.
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ce17c3-fd12-4026-a783-bdf0b3c8b5db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[af97b3de-d5bc-480e-9476-0fca30bcfed7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[da84f1d7-cb5d-4cca-8267-d4351fb3203c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e393571-f53d-46d0-8105-97f24215341f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:04:40 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[89615164-6b6e-4c60-a073-02609cd10d56]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG os_brick.utils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updating existing volume attachment record: 6e35ab63-0eaf-46da-b47b-519148ada944 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:04:40 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Instance destroyed successfully.
Oct 30 11:04:40 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Attempting a stable device rescue
Oct 30 11:04:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74278) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Instance directory exists: not creating {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 11:04:40 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Creating image(s)
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "/opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "/opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG nova.objects.instance [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6d868c1e-1985-48b6-a881-4d17b364701a {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "cbf2a305358d2c8be13b8eb7d943e9ab3f459a79" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "cbf2a305358d2c8be13b8eb7d943e9ab3f459a79" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79.part --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79.part --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.images [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] fc57a2c4-d163-4972-8ddc-3f93e3861e3c was qcow2, converting to raw {{(pid=74278) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79.part /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79.converted {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79.part /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79.converted" returned: 0 in 0.244s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79.converted --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-c894b9d4-b67c-4d11-bad2-07f619081cf9 req-e3512f56-61b5-4665-bee3-6b7a5769a5a2 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c894b9d4-b67c-4d11-bad2-07f619081cf9 req-e3512f56-61b5-4665-bee3-6b7a5769a5a2 service nova] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c894b9d4-b67c-4d11-bad2-07f619081cf9 req-e3512f56-61b5-4665-bee3-6b7a5769a5a2 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c894b9d4-b67c-4d11-bad2-07f619081cf9 req-e3512f56-61b5-4665-bee3-6b7a5769a5a2 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-c894b9d4-b67c-4d11-bad2-07f619081cf9 req-e3512f56-61b5-4665-bee3-6b7a5769a5a2 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] No waiting events found dispatching network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:04:42 user nova-compute[74278]: WARNING nova.compute.manager [req-c894b9d4-b67c-4d11-bad2-07f619081cf9 req-e3512f56-61b5-4665-bee3-6b7a5769a5a2 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received unexpected event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b for instance with vm_state active and task_state rescuing.
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "cbf2a305358d2c8be13b8eb7d943e9ab3f459a79" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.587s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "cbf2a305358d2c8be13b8eb7d943e9ab3f459a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "cbf2a305358d2c8be13b8eb7d943e9ab3f459a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79 --force-share --output=json" returned: 0 in 0.171s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79,backing_fmt=raw /opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/disk.rescue {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79,backing_fmt=raw /opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/disk.rescue" returned: 0 in 0.047s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "cbf2a305358d2c8be13b8eb7d943e9ab3f459a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.objects.instance [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'migration_context' on Instance uuid 6d868c1e-1985-48b6-a881-4d17b364701a {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.objects.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Object Instance<6d868c1e-1985-48b6-a881-4d17b364701a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Start _get_guest_xml network_info=[{"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "vif_mac": "fa:16:3e:64:13:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fc57a2c4-d163-4972-8ddc-3f93e3861e3c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCSOnfXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6d868c1e-1985-48b6-a881-4d17b364701a', 'attached_at': '', 'detached_at': '', 'volume_id': '4984245f-1520-4324-898f-ab595bc0beb3', 'serial': '4984245f-1520-4324-898f-ab595bc0beb3'}, 'attachment_id': 'b845a41d-422b-4546-839c-ac9c1e55f314', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.objects.instance [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'resources' on Instance uuid 6d868c1e-1985-48b6-a881-4d17b364701a {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.objects.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Object Instance<6d868c1e-1985-48b6-a881-4d17b364701a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.objects.instance [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'numa_topology' on Instance uuid 6d868c1e-1985-48b6-a881-4d17b364701a {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.objects.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Object Instance<6d868c1e-1985-48b6-a881-4d17b364701a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:04:42 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:04:42 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.objects.instance [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6d868c1e-1985-48b6-a881-4d17b364701a {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.objects.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Object Instance<6d868c1e-1985-48b6-a881-4d17b364701a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCSOnfXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:04:42 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:04:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:04:42 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:04:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:04:42 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddf814d-f350-4c45-9520-aacb4e6dc8a8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NCSOnfXT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 30 11:04:42 user nova-compute[74278]: node.name = iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3
Oct 30 11:04:42 user nova-compute[74278]: node.tpgt = -1
Oct 30 11:04:42 user nova-compute[74278]: node.startup = automatic
Oct 30 11:04:42 user nova-compute[74278]: node.leading_login = No
Oct 30 11:04:42 user nova-compute[74278]: iface.iscsi_ifacename = default
Oct 30 11:04:42 user nova-compute[74278]: iface.net_ifacename = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.ipaddress = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.prefix_len = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.hwaddress = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.transport_name = tcp
Oct 30 11:04:42 user nova-compute[74278]: iface.initiatorname = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.state = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.vlan_id = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.vlan_priority = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.vlan_state = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.iface_num = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.mtu = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.port = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.bootproto = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.subnet_mask = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.gateway = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.dhcp_alt_client_id_state = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.dhcp_alt_client_id = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.dhcp_dns = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.dhcp_learn_iqn = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.dhcp_req_vendor_id_state = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.dhcp_vendor_id_state = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.dhcp_vendor_id = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.dhcp_slp_da = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.fragmentation = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.gratuitous_arp = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.incoming_forwarding = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.tos_state = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.tos = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.ttl = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.delayed_ack = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.tcp_nagle = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.tcp_wsf_state = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.tcp_wsf = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.tcp_timer_scale = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.tcp_timestamp = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.redirect = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.def_task_mgmt_timeout = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.header_digest = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.data_digest = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.immediate_data = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.initial_r2t = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.data_seq_inorder = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.data_pdu_inorder = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.erl = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.max_receive_data_len = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.first_burst_len = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.max_outstanding_r2t = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.max_burst_len = 0
Oct 30 11:04:42 user nova-compute[74278]: iface.chap_auth = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.bidi_chap = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.strict_login_compliance = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.discovery_auth = <empty>
Oct 30 11:04:42 user nova-compute[74278]: iface.discovery_logout = <empty>
Oct 30 11:04:42 user nova-compute[74278]: node.discovery_address = <empty>
Oct 30 11:04:42 user nova-compute[74278]: node.discovery_port = 0
Oct 30 11:04:42 user nova-compute[74278]: node.discovery_type = static
Oct 30 11:04:42 user nova-compute[74278]: node.session.initial_cmdsn = 0
Oct 30 11:04:42 user nova-compute[74278]: node.session.initial_login_retry_max = 8
Oct 30 11:04:42 user nova-compute[74278]: node.session.xmit_thread_priority = -20
Oct 30 11:04:42 user nova-compute[74278]: node.session.cmds_max = 128
Oct 30 11:04:42 user nova-compute[74278]: node.session.queue_depth = 32
Oct 30 11:04:42 user nova-compute[74278]: node.session.nr_sessions = 1
Oct 30 11:04:42 user nova-compute[74278]: node.session.auth.authmethod = CHAP
Oct 30 11:04:42 user nova-compute[74278]: node.session.auth.username = NCSOnfXT
Oct 30 11:04:42 user nova-compute[74278]: node.session.auth.password = ***
Oct 30 11:04:42 user nova-compute[74278]: node.session.auth.username_in = <empty>
Oct 30 11:04:42 user nova-compute[74278]: node.session.auth.password_in = <empty>
Oct 30 11:04:42 user nova-compute[74278]: node.session.auth.chap_algs = MD5
Oct 30 11:04:42 user nova-compute[74278]: node.session.timeo.replacement_timeout = 120
Oct 30 11:04:42 user nova-compute[74278]: node.session.err_timeo.abort_timeout = 15
Oct 30 11:04:42 user nova-compute[74278]: node.session.err_timeo.lu_reset_timeout = 30
Oct 30 11:04:42 user nova-compute[74278]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 30 11:04:42 user nova-compute[74278]: node.session.err_timeo.host_reset_timeout = 60
Oct 30 11:04:42 user nova-compute[74278]: node.session.iscsi.FastAbort = Yes
Oct 30 11:04:42 user nova-compute[74278]: node.session.iscsi.InitialR2T = No
Oct 30 11:04:42 user nova-compute[74278]: node.session.iscsi.ImmediateData = Yes
Oct 30 11:04:42 user nova-compute[74278]: node.session.iscsi.FirstBurstLength = 262144
Oct 30 11:04:42 user nova-compute[74278]: node.session.iscsi.MaxBurstLength = 16776192
Oct 30 11:04:42 user nova-compute[74278]: node.session.iscsi.DefaultTime2Retain = 0
Oct 30 11:04:42 user nova-compute[74278]: node.session.iscsi.DefaultTime2Wait = 2
Oct 30 11:04:42 user nova-compute[74278]: node.session.iscsi.MaxConnections = 1
Oct 30 11:04:42 user nova-compute[74278]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 30 11:04:42 user nova-compute[74278]: node.session.iscsi.ERL = 0
Oct 30 11:04:42 user nova-compute[74278]: node.session.scan = manual
Oct 30 11:04:42 user nova-compute[74278]: node.session.reopen_max = 0
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].address = 172.16.0.220
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].port = 3260
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].startup = manual
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].tcp.window_size = 524288
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].tcp.type_of_service = 0
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].timeo.logout_timeout = 15
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].timeo.login_timeout = 15
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].timeo.auth_timeout = 45
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].timeo.noop_out_interval = 5
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].timeo.noop_out_timeout = 5
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].iscsi.HeaderDigest = None
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].iscsi.DataDigest = None
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].iscsi.IFMarker = No
Oct 30 11:04:42 user nova-compute[74278]: node.conn[0].iscsi.OFMarker = No
Oct 30 11:04:42 user nova-compute[74278]: # END RECORD
Oct 30 11:04:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edf1329-5f36-490c-8be4-b889f85748b5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94b4a94-ca89-44d1-8615-3fba68b02227]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCSOnfXT {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NCSOnfXT" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ac28a3-b0de-4daf-828b-1dff446da568]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NCSOnfXT'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8078cd-8c40-4dbf-8706-05226992e025]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:04:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[64406d09-0343-4932-a085-1f487912929c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:04:43 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:04:43 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:04:43 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:04:43 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:04:43 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:04:43 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:04:43 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:04:43 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] HCTL ('34', '0', '0', 0) found on session 29 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.012s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[722bad6e-ba24-433d-b59f-f93f9b508274]: (4, ('0 0 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Searching for a device in session 29 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCSOnfXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.173s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '23966616337366131', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966616337366131', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-830327174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-830327174',id=29,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:02:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-b80tqbwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:02:49Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=6d868c1e-1985-48b6-a881-4d17b364701a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "vif_mac": "fa:16:3e:64:13:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "vif_mac": "fa:16:3e:64:13:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c0e1514-8d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG nova.objects.instance [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d868c1e-1985-48b6-a881-4d17b364701a {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG nova.objects.base [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Object Instance<6d868c1e-1985-48b6-a881-4d17b364701a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:04:43 user nova-compute[74278]:   <uuid>6d868c1e-1985-48b6-a881-4d17b364701a</uuid>
Oct 30 11:04:43 user nova-compute[74278]:   <name>instance-0000001d</name>
Oct 30 11:04:43 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:04:43 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:04:43 user nova-compute[74278]:   <metadata>
Oct 30 11:04:43 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:04:43 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:04:43 user nova-compute[74278]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-830327174</nova:name>
Oct 30 11:04:43 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:04:42</nova:creationTime>
Oct 30 11:04:43 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:04:43 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:04:43 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:04:43 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:04:43 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:04:43 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:04:43 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:04:43 user nova-compute[74278]:       <nova:owner>
Oct 30 11:04:43 user nova-compute[74278]:         <nova:user uuid="e6e338955c2f4d4fae81e9fbf93eff39">tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member</nova:user>
Oct 30 11:04:43 user nova-compute[74278]:         <nova:project uuid="0f6de366be034e23a4d60302674b76c9">tempest-ServerBootFromVolumeStableRescueTest-1058902108</nova:project>
Oct 30 11:04:43 user nova-compute[74278]:       </nova:owner>
Oct 30 11:04:43 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:04:43 user nova-compute[74278]:       <nova:ports>
Oct 30 11:04:43 user nova-compute[74278]:         <nova:port uuid="1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b">
Oct 30 11:04:43 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 11:04:43 user nova-compute[74278]:         </nova:port>
Oct 30 11:04:43 user nova-compute[74278]:       </nova:ports>
Oct 30 11:04:43 user nova-compute[74278]:     </nova:instance>
Oct 30 11:04:43 user nova-compute[74278]:   </metadata>
Oct 30 11:04:43 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:04:43 user nova-compute[74278]:     <system>
Oct 30 11:04:43 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:04:43 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:04:43 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:04:43 user nova-compute[74278]:       <entry name="serial">6d868c1e-1985-48b6-a881-4d17b364701a</entry>
Oct 30 11:04:43 user nova-compute[74278]:       <entry name="uuid">6d868c1e-1985-48b6-a881-4d17b364701a</entry>
Oct 30 11:04:43 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:04:43 user nova-compute[74278]:     </system>
Oct 30 11:04:43 user nova-compute[74278]:   </sysinfo>
Oct 30 11:04:43 user nova-compute[74278]:   <os>
Oct 30 11:04:43 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:04:43 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:04:43 user nova-compute[74278]:   </os>
Oct 30 11:04:43 user nova-compute[74278]:   <features>
Oct 30 11:04:43 user nova-compute[74278]:     <acpi/>
Oct 30 11:04:43 user nova-compute[74278]:     <apic/>
Oct 30 11:04:43 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:04:43 user nova-compute[74278]:   </features>
Oct 30 11:04:43 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:04:43 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:04:43 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:04:43 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:04:43 user nova-compute[74278]:   </clock>
Oct 30 11:04:43 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:04:43 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:04:43 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:04:43 user nova-compute[74278]:   </cpu>
Oct 30 11:04:43 user nova-compute[74278]:   <devices>
Oct 30 11:04:43 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:04:43 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:04:43 user nova-compute[74278]:       <source dev="/dev/sdc"/>
Oct 30 11:04:43 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:04:43 user nova-compute[74278]:       <serial>4984245f-1520-4324-898f-ab595bc0beb3</serial>
Oct 30 11:04:43 user nova-compute[74278]:     </disk>
Oct 30 11:04:43 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:04:43 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:04:43 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/disk.rescue"/>
Oct 30 11:04:43 user nova-compute[74278]:       <target dev="vdb" bus="virtio"/>
Oct 30 11:04:43 user nova-compute[74278]:       <boot order="1"/>
Oct 30 11:04:43 user nova-compute[74278]:     </disk>
Oct 30 11:04:43 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:04:43 user nova-compute[74278]:       <mac address="fa:16:3e:64:13:1b"/>
Oct 30 11:04:43 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:04:43 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:04:43 user nova-compute[74278]:       <target dev="tap1c0e1514-8d"/>
Oct 30 11:04:43 user nova-compute[74278]:     </interface>
Oct 30 11:04:43 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:04:43 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/console.log" append="off"/>
Oct 30 11:04:43 user nova-compute[74278]:     </serial>
Oct 30 11:04:43 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:04:43 user nova-compute[74278]:     <video>
Oct 30 11:04:43 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:04:43 user nova-compute[74278]:     </video>
Oct 30 11:04:43 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:04:43 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:04:43 user nova-compute[74278]:     </rng>
Oct 30 11:04:43 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:04:43 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:04:43 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:04:43 user nova-compute[74278]:     </memballoon>
Oct 30 11:04:43 user nova-compute[74278]:   </devices>
Oct 30 11:04:43 user nova-compute[74278]: </domain>
Oct 30 11:04:43 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:04:43 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Instance destroyed successfully.
Oct 30 11:04:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:04:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] No VIF found with MAC fa:16:3e:64:13:1b, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:04:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-3fd9b9b8-0b15-4f0c-bcd4-a19dab19ab8f req-d8fda3ba-8f70-4561-adbe-f1b287f65f50 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3fd9b9b8-0b15-4f0c-bcd4-a19dab19ab8f req-d8fda3ba-8f70-4561-adbe-f1b287f65f50 service nova] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3fd9b9b8-0b15-4f0c-bcd4-a19dab19ab8f req-d8fda3ba-8f70-4561-adbe-f1b287f65f50 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3fd9b9b8-0b15-4f0c-bcd4-a19dab19ab8f req-d8fda3ba-8f70-4561-adbe-f1b287f65f50 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-3fd9b9b8-0b15-4f0c-bcd4-a19dab19ab8f req-d8fda3ba-8f70-4561-adbe-f1b287f65f50 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] No waiting events found dispatching network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:04:44 user nova-compute[74278]: WARNING nova.compute.manager [req-3fd9b9b8-0b15-4f0c-bcd4-a19dab19ab8f req-d8fda3ba-8f70-4561-adbe-f1b287f65f50 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received unexpected event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b for instance with vm_state active and task_state rescuing.
Oct 30 11:04:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "283358a3-e52d-4019-8d88-8f86d456122f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "283358a3-e52d-4019-8d88-8f86d456122f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "283358a3-e52d-4019-8d88-8f86d456122f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "283358a3-e52d-4019-8d88-8f86d456122f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "283358a3-e52d-4019-8d88-8f86d456122f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:45 user nova-compute[74278]: INFO nova.compute.manager [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Terminating instance
Oct 30 11:04:45 user nova-compute[74278]: DEBUG nova.compute.manager [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:04:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:46 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Instance destroyed successfully.
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.objects.instance [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lazy-loading 'resources' on Instance uuid 283358a3-e52d-4019-8d88-8f86d456122f {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1104859434',display_name='tempest-VolumesActionsTest-instance-1104859434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1104859434',id=30,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:03:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6516f9ae7cc1453db5bea067d108eed1',ramdisk_id='',reservation_id='r-wk8x9q36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1938085894',owner_user_name='tempest-VolumesActionsTest-1938085894-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:03:05Z,user_data=None,user_id='2a8ce768d96b4d42ae87c9e3af6c4592',uuid=283358a3-e52d-4019-8d88-8f86d456122f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "address": "fa:16:3e:6a:3b:7a", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef4ca6a-60", "ovs_interfaceid": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Converting VIF {"id": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "address": "fa:16:3e:6a:3b:7a", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef4ca6a-60", "ovs_interfaceid": "7ef4ca6a-60b8-42a8-b439-85ff898b9c79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3b:7a,bridge_name='br-int',has_traffic_filtering=True,id=7ef4ca6a-60b8-42a8-b439-85ff898b9c79,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef4ca6a-60') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG os_vif [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3b:7a,bridge_name='br-int',has_traffic_filtering=True,id=7ef4ca6a-60b8-42a8-b439-85ff898b9c79,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef4ca6a-60') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ef4ca6a-60, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25ca2591-d96f-4598-9c5d-650f8c89fd73) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:04:46 user nova-compute[74278]: INFO os_vif [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3b:7a,bridge_name='br-int',has_traffic_filtering=True,id=7ef4ca6a-60b8-42a8-b439-85ff898b9c79,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef4ca6a-60')
Oct 30 11:04:46 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Deleting instance files /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f_del
Oct 30 11:04:46 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Deletion of /opt/stack/data/nova/instances/283358a3-e52d-4019-8d88-8f86d456122f_del complete
Oct 30 11:04:46 user nova-compute[74278]: INFO nova.compute.manager [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 30 11:04:46 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] No waiting events found dispatching network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:04:46 user nova-compute[74278]: WARNING nova.compute.manager [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received unexpected event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b for instance with vm_state active and task_state rescuing.
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Received event network-vif-unplugged-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] Acquiring lock "283358a3-e52d-4019-8d88-8f86d456122f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] Lock "283358a3-e52d-4019-8d88-8f86d456122f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] Lock "283358a3-e52d-4019-8d88-8f86d456122f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] No waiting events found dispatching network-vif-unplugged-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Received event network-vif-unplugged-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Received event network-vif-plugged-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] Acquiring lock "283358a3-e52d-4019-8d88-8f86d456122f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] Lock "283358a3-e52d-4019-8d88-8f86d456122f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] Lock "283358a3-e52d-4019-8d88-8f86d456122f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] No waiting events found dispatching network-vif-plugged-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:04:46 user nova-compute[74278]: WARNING nova.compute.manager [req-b1c18ec4-d5d9-493b-94f3-e5ced8be22d5 req-7c4fdc26-ef38-4dc0-8beb-24b8db904a50 service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Received unexpected event network-vif-plugged-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 for instance with vm_state active and task_state deleting.
Oct 30 11:04:46 user nova-compute[74278]: DEBUG nova.compute.manager [None req-18619f5d-751a-4850-a4d3-2d9e224e70f7 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:04:47 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:04:47 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Took 0.56 seconds to deallocate network for instance.
Oct 30 11:04:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-177742f2-f0c3-4362-8c17-fb006f79a9bb req-6237f214-af26-4ecd-9d3d-656a3f984a6b service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Received event network-vif-deleted-7ef4ca6a-60b8-42a8-b439-85ff898b9c79 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:04:47 user nova-compute[74278]: INFO nova.compute.manager [req-177742f2-f0c3-4362-8c17-fb006f79a9bb req-6237f214-af26-4ecd-9d3d-656a3f984a6b service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Neutron deleted interface 7ef4ca6a-60b8-42a8-b439-85ff898b9c79; detaching it from the instance and deleting it from the info cache
Oct 30 11:04:47 user nova-compute[74278]: DEBUG nova.network.neutron [req-177742f2-f0c3-4362-8c17-fb006f79a9bb req-6237f214-af26-4ecd-9d3d-656a3f984a6b service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:04:47 user nova-compute[74278]: DEBUG nova.compute.manager [req-177742f2-f0c3-4362-8c17-fb006f79a9bb req-6237f214-af26-4ecd-9d3d-656a3f984a6b service nova] [instance: 283358a3-e52d-4019-8d88-8f86d456122f] Detach interface failed, port_id=7ef4ca6a-60b8-42a8-b439-85ff898b9c79, reason: Instance 283358a3-e52d-4019-8d88-8f86d456122f could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:04:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:04:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:04:47 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:04:47 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:04:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:47 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Deleted allocations for instance 283358a3-e52d-4019-8d88-8f86d456122f
Oct 30 11:04:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-bc80d1f0-6915-4314-b72d-f14e5e522c7d tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "283358a3-e52d-4019-8d88-8f86d456122f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:04:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:04:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:01 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'pci_requests' on Instance uuid 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:05:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:01 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'numa_topology' on Instance uuid 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:05:01 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:05:01 user nova-compute[74278]: INFO nova.compute.claims [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Claim successful on node user
Oct 30 11:05:01 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:05:01 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:05:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:02 user nova-compute[74278]: INFO nova.network.neutron [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updating port 0ca50716-192b-473f-bc5a-d1136a8d52dd with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquired lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG nova.network.neutron [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-b0cb6f43-31e2-4169-a0ca-d2c8d3af1c36 req-40fa7a64-3c14-432e-adab-ce0a9db2f504 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-changed-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-b0cb6f43-31e2-4169-a0ca-d2c8d3af1c36 req-40fa7a64-3c14-432e-adab-ce0a9db2f504 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Refreshing instance network info cache due to event network-changed-0ca50716-192b-473f-bc5a-d1136a8d52dd. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0cb6f43-31e2-4169-a0ca-d2c8d3af1c36 req-40fa7a64-3c14-432e-adab-ce0a9db2f504 service nova] Acquiring lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG nova.network.neutron [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updating instance_info_cache with network_info: [{"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Releasing lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:05:02 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Creating image(s)
Oct 30 11:05:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "/opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "/opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0cb6f43-31e2-4169-a0ca-d2c8d3af1c36 req-40fa7a64-3c14-432e-adab-ce0a9db2f504 service nova] Acquired lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:05:02 user nova-compute[74278]: DEBUG nova.network.neutron [req-b0cb6f43-31e2-4169-a0ca-d2c8d3af1c36 req-40fa7a64-3c14-432e-adab-ce0a9db2f504 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Refreshing network info cache for port 0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:05:03 user nova-compute[74278]: DEBUG nova.objects.base [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Object Instance<5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:05:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "5dbb91e5cff548f80771b023d1f8113efab93a95" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5dbb91e5cff548f80771b023d1f8113efab93a95" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95.part --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:03 user nova-compute[74278]: INFO nova.compute.manager [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Terminating instance
Oct 30 11:05:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.virt.images [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] a668b9fb-576d-47ad-a940-ceaccf81af56 was qcow2, converting to raw {{(pid=74278) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95.part /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95.converted {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95.part /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95.converted" returned: 0 in 0.243s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95.converted --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.network.neutron [req-b0cb6f43-31e2-4169-a0ca-d2c8d3af1c36 req-40fa7a64-3c14-432e-adab-ce0a9db2f504 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updated VIF entry in instance network info cache for port 0ca50716-192b-473f-bc5a-d1136a8d52dd. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.network.neutron [req-b0cb6f43-31e2-4169-a0ca-d2c8d3af1c36 req-40fa7a64-3c14-432e-adab-ce0a9db2f504 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updating instance_info_cache with network_info: [{"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0cb6f43-31e2-4169-a0ca-d2c8d3af1c36 req-40fa7a64-3c14-432e-adab-ce0a9db2f504 service nova] Releasing lock "refresh_cache-5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5dbb91e5cff548f80771b023d1f8113efab93a95" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.482s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95 --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "5dbb91e5cff548f80771b023d1f8113efab93a95" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5dbb91e5cff548f80771b023d1f8113efab93a95" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-e3fac73c-2ced-460e-9c12-dc783d729237 req-e0786e95-72ee-43c9-9b61-960ae29daa7f service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-vif-unplugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e3fac73c-2ced-460e-9c12-dc783d729237 req-e0786e95-72ee-43c9-9b61-960ae29daa7f service nova] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e3fac73c-2ced-460e-9c12-dc783d729237 req-e0786e95-72ee-43c9-9b61-960ae29daa7f service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e3fac73c-2ced-460e-9c12-dc783d729237 req-e0786e95-72ee-43c9-9b61-960ae29daa7f service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-e3fac73c-2ced-460e-9c12-dc783d729237 req-e0786e95-72ee-43c9-9b61-960ae29daa7f service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] No waiting events found dispatching network-vif-unplugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-e3fac73c-2ced-460e-9c12-dc783d729237 req-e0786e95-72ee-43c9-9b61-960ae29daa7f service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-vif-unplugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-e3fac73c-2ced-460e-9c12-dc783d729237 req-e0786e95-72ee-43c9-9b61-960ae29daa7f service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e3fac73c-2ced-460e-9c12-dc783d729237 req-e0786e95-72ee-43c9-9b61-960ae29daa7f service nova] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e3fac73c-2ced-460e-9c12-dc783d729237 req-e0786e95-72ee-43c9-9b61-960ae29daa7f service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e3fac73c-2ced-460e-9c12-dc783d729237 req-e0786e95-72ee-43c9-9b61-960ae29daa7f service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-e3fac73c-2ced-460e-9c12-dc783d729237 req-e0786e95-72ee-43c9-9b61-960ae29daa7f service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] No waiting events found dispatching network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:04 user nova-compute[74278]: WARNING nova.compute.manager [req-e3fac73c-2ced-460e-9c12-dc783d729237 req-e0786e95-72ee-43c9-9b61-960ae29daa7f service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received unexpected event network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 for instance with vm_state active and task_state deleting.
Oct 30 11:05:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Instance destroyed successfully.
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lazy-loading 'resources' on Instance uuid ef2b0994-a1be-49f5-8617-7fedfeaeca6c {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-743465971',display_name='tempest-AttachVolumeNegativeTest-server-743465971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-743465971',id=28,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLn3Us0FIKYgjui5Xn5D60bg+l2VlVAg3Prk/TVIxKtCfFcUlgT4NaSoRl0wx0HQXx9fJzwdz4+ZltJlhR6Uq95wYJVfADSCeWNfD5taZ+QbT4wNhCliKMGsju9Duwt0Q==',key_name='tempest-keypair-1353853241',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:01:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b43bf73deda348f08290daf640768705',ramdisk_id='',reservation_id='r-ln87t0d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-871157650',owner_user_name='tempest-AttachVolumeNegativeTest-871157650-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:01:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31e7e6847ec0415fba0fd909c014e802',uuid=ef2b0994-a1be-49f5-8617-7fedfeaeca6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "address": "fa:16:3e:59:0c:4c", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3138d8fd-1e", "ovs_interfaceid": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converting VIF {"id": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "address": "fa:16:3e:59:0c:4c", "network": {"id": "1dbee25c-5478-4a9e-92ba-a99efd48e9f5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1551187946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b43bf73deda348f08290daf640768705", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3138d8fd-1e", "ovs_interfaceid": "3138d8fd-1eed-4c93-ad49-bddc7e9bed81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:0c:4c,bridge_name='br-int',has_traffic_filtering=True,id=3138d8fd-1eed-4c93-ad49-bddc7e9bed81,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3138d8fd-1e') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG os_vif [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:0c:4c,bridge_name='br-int',has_traffic_filtering=True,id=3138d8fd-1eed-4c93-ad49-bddc7e9bed81,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3138d8fd-1e') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3138d8fd-1e, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff5c963f-f1bb-4c14-9a13-e1265fbac1cf) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:04 user nova-compute[74278]: INFO os_vif [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:0c:4c,bridge_name='br-int',has_traffic_filtering=True,id=3138d8fd-1eed-4c93-ad49-bddc7e9bed81,network=Network(1dbee25c-5478-4a9e-92ba-a99efd48e9f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3138d8fd-1e')
Oct 30 11:05:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Deleting instance files /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c_del
Oct 30 11:05:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Deletion of /opt/stack/data/nova/instances/ef2b0994-a1be-49f5-8617-7fedfeaeca6c_del complete
Oct 30 11:05:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95 --force-share --output=json" returned: 0 in 0.200s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95,backing_fmt=raw /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95,backing_fmt=raw /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk 1073741824" returned: 0 in 0.051s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5dbb91e5cff548f80771b023d1f8113efab93a95" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:04 user nova-compute[74278]: INFO nova.compute.manager [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 30 11:05:04 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:05:04 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:05:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95 --force-share --output=json" returned: 0 in 0.185s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:05 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'migration_context' on Instance uuid 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:05:05 user nova-compute[74278]: DEBUG nova.objects.base [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Object Instance<5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:05:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Rebasing disk image.
Oct 30 11:05:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.172s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 -F raw /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] No waiting events found dispatching network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:06 user nova-compute[74278]: WARNING nova.compute.manager [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received unexpected event network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 for instance with vm_state active and task_state deleting.
Oct 30 11:05:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] No waiting events found dispatching network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:06 user nova-compute[74278]: WARNING nova.compute.manager [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received unexpected event network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 for instance with vm_state active and task_state deleting.
Oct 30 11:05:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-vif-unplugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] No waiting events found dispatching network-vif-unplugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-vif-unplugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] Acquiring lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] No waiting events found dispatching network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:06 user nova-compute[74278]: WARNING nova.compute.manager [req-3e45c316-1a5b-4ddb-a1dd-052e1bb1843e req-d6e82d46-3a72-4dbd-9cad-823d36d43800 service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received unexpected event network-vif-plugged-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 for instance with vm_state active and task_state deleting.
Oct 30 11:05:06 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:05:06 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Took 1.89 seconds to deallocate network for instance.
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:07 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Deleted allocations for instance ef2b0994-a1be-49f5-8617-7fedfeaeca6c
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-56b6ee00-0867-4b1f-bcff-96c554f46167 tempest-AttachVolumeNegativeTest-871157650 tempest-AttachVolumeNegativeTest-871157650-project-member] Lock "ef2b0994-a1be-49f5-8617-7fedfeaeca6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.555s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 -F raw /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk" returned: 0 in 2.332s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Ensure instance console log exists: /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Start _get_guest_xml network_info=[{"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c52b2a8b90db380fc83afcb4856366ad',container_format='bare',created_at=2023-10-30T11:02:48Z,direct_url=<?>,disk_format='qcow2',id=a668b9fb-576d-47ad-a940-ceaccf81af56,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1355088922-shelved',owner='31dd01e2d9be4a0b96e94493f8eb43d7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T11:02:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQuAaEqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3', 'attached_at': '', 'detached_at': '', 'volume_id': '00a4d066-fc8a-4376-badd-5ed405442e93', 'serial': '00a4d066-fc8a-4376-badd-5ed405442e93'}, 'attachment_id': '6e35ab63-0eaf-46da-b47b-519148ada944', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:05:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:05:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c52b2a8b90db380fc83afcb4856366ad',container_format='bare',created_at=2023-10-30T11:02:48Z,direct_url=<?>,disk_format='qcow2',id=a668b9fb-576d-47ad-a940-ceaccf81af56,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1355088922-shelved',owner='31dd01e2d9be4a0b96e94493f8eb43d7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T11:02:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.objects.base [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Object Instance<5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQuAaEqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:05:07 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:05:07 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:05:07 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260" returned: 21 in 0.053s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b9f510-8301-43e2-90e7-54716730dd11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:05:07 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af4f56f-fa4d-430e-bcce-a7d180877021]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93] added
Oct 30 11:05:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[466cdb51-caed-4d9c-bb83-491ab3723415]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ea9b25-8b7e-4e10-906e-abcbaa371aa5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQuAaEqh {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQuAaEqh" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2ec601-1528-460e-82b3-4cb6f90e8c0d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dQuAaEqh'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb98779-d0f5-43ae-bc16-862f679508cb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8110b793-d3e5-47f4-a78f-c80cb0f9212b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:05:07 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:05:07 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:05:07 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:05:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:05:07 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:05:07 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:05:07 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:05:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:05:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ef128c-cf44-4a3f-b9e3-cc1eadb7f416]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93, portal: 172.16.0.220,3260]
Oct 30 11:05:08 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93, portal: 172.16.0.220,3260] successful.
Oct 30 11:05:08 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[792e2333-ef9a-47b0-bb06-cd545497d3c2]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c607b390-88a6-4bb6-84f0-eb3d58d8cb96]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:05:08 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:05:08 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:05:08 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:05:08 user nova-compute[74278]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)
Oct 30 11:05:08 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:05:08 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:05:08 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:05:08 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:05:08 user nova-compute[74278]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)
Oct 30 11:05:08 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0674f4c-4116-4a7c-a29a-fa4910b7bb18]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQuAaEqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:05:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-e5990281-f911-4b58-87db-04c737367ac7 req-6eb6920e-7f84-456e-b0dd-3be8851fb86b service nova] [instance: ef2b0994-a1be-49f5-8617-7fedfeaeca6c] Received event network-vif-deleted-3138d8fd-1eed-4c93-ad49-bddc7e9bed81 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23938383936666466', 'path': '/dev/sde'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938383936666466', 'path': '/dev/sde'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1355088922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1355088922',id=25,image_ref='a668b9fb-576d-47ad-a940-ceaccf81af56',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-344221549',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:00:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='31dd01e2d9be4a0b96e94493f8eb43d7',ramdisk_id='',reservation_id='r-y1dpjo0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2142703659',owner_user_name='tempest-AttachVolumeShelveTestJSON-2142703659-project-member',shelved_at='2023-10-30T11:02:53.835836',shelved_host='user',shelved_image_id='a668b9fb-576d-47ad-a940-ceaccf81af56'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584de218cec24240a91845deca515efa',uuid=5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converting VIF {"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.objects.base [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Object Instance<5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:05:09 user nova-compute[74278]:   <uuid>5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3</uuid>
Oct 30 11:05:09 user nova-compute[74278]:   <name>instance-00000019</name>
Oct 30 11:05:09 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:05:09 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:05:09 user nova-compute[74278]:   <metadata>
Oct 30 11:05:09 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:05:09 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:05:09 user nova-compute[74278]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1355088922</nova:name>
Oct 30 11:05:09 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:05:07</nova:creationTime>
Oct 30 11:05:09 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:05:09 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:05:09 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:05:09 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:05:09 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:05:09 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:05:09 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:05:09 user nova-compute[74278]:       <nova:owner>
Oct 30 11:05:09 user nova-compute[74278]:         <nova:user uuid="584de218cec24240a91845deca515efa">tempest-AttachVolumeShelveTestJSON-2142703659-project-member</nova:user>
Oct 30 11:05:09 user nova-compute[74278]:         <nova:project uuid="31dd01e2d9be4a0b96e94493f8eb43d7">tempest-AttachVolumeShelveTestJSON-2142703659</nova:project>
Oct 30 11:05:09 user nova-compute[74278]:       </nova:owner>
Oct 30 11:05:09 user nova-compute[74278]:       <nova:root type="image" uuid="a668b9fb-576d-47ad-a940-ceaccf81af56"/>
Oct 30 11:05:09 user nova-compute[74278]:       <nova:ports>
Oct 30 11:05:09 user nova-compute[74278]:         <nova:port uuid="0ca50716-192b-473f-bc5a-d1136a8d52dd">
Oct 30 11:05:09 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 11:05:09 user nova-compute[74278]:         </nova:port>
Oct 30 11:05:09 user nova-compute[74278]:       </nova:ports>
Oct 30 11:05:09 user nova-compute[74278]:     </nova:instance>
Oct 30 11:05:09 user nova-compute[74278]:   </metadata>
Oct 30 11:05:09 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:05:09 user nova-compute[74278]:     <system>
Oct 30 11:05:09 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:05:09 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:05:09 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:05:09 user nova-compute[74278]:       <entry name="serial">5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3</entry>
Oct 30 11:05:09 user nova-compute[74278]:       <entry name="uuid">5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3</entry>
Oct 30 11:05:09 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:05:09 user nova-compute[74278]:     </system>
Oct 30 11:05:09 user nova-compute[74278]:   </sysinfo>
Oct 30 11:05:09 user nova-compute[74278]:   <os>
Oct 30 11:05:09 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:05:09 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:05:09 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:05:09 user nova-compute[74278]:   </os>
Oct 30 11:05:09 user nova-compute[74278]:   <features>
Oct 30 11:05:09 user nova-compute[74278]:     <acpi/>
Oct 30 11:05:09 user nova-compute[74278]:     <apic/>
Oct 30 11:05:09 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:05:09 user nova-compute[74278]:   </features>
Oct 30 11:05:09 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:05:09 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:05:09 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:05:09 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:05:09 user nova-compute[74278]:   </clock>
Oct 30 11:05:09 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:05:09 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:05:09 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:05:09 user nova-compute[74278]:   </cpu>
Oct 30 11:05:09 user nova-compute[74278]:   <devices>
Oct 30 11:05:09 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:05:09 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:05:09 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk"/>
Oct 30 11:05:09 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:05:09 user nova-compute[74278]:     </disk>
Oct 30 11:05:09 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:05:09 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:05:09 user nova-compute[74278]:       <source dev="/dev/sde"/>
Oct 30 11:05:09 user nova-compute[74278]:       <target dev="vdc" bus="virtio"/>
Oct 30 11:05:09 user nova-compute[74278]:       <serial>00a4d066-fc8a-4376-badd-5ed405442e93</serial>
Oct 30 11:05:09 user nova-compute[74278]:     </disk>
Oct 30 11:05:09 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:05:09 user nova-compute[74278]:       <mac address="fa:16:3e:12:c3:5f"/>
Oct 30 11:05:09 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:05:09 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:05:09 user nova-compute[74278]:       <target dev="tap0ca50716-19"/>
Oct 30 11:05:09 user nova-compute[74278]:     </interface>
Oct 30 11:05:09 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:05:09 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/console.log" append="off"/>
Oct 30 11:05:09 user nova-compute[74278]:     </serial>
Oct 30 11:05:09 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:05:09 user nova-compute[74278]:     <video>
Oct 30 11:05:09 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:05:09 user nova-compute[74278]:     </video>
Oct 30 11:05:09 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:05:09 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:05:09 user nova-compute[74278]:     </rng>
Oct 30 11:05:09 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:05:09 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:05:09 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:05:09 user nova-compute[74278]:     </memballoon>
Oct 30 11:05:09 user nova-compute[74278]:   </devices>
Oct 30 11:05:09 user nova-compute[74278]: </domain>
Oct 30 11:05:09 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1355088922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1355088922',id=25,image_ref='a668b9fb-576d-47ad-a940-ceaccf81af56',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-344221549',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:00:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='31dd01e2d9be4a0b96e94493f8eb43d7',ramdisk_id='',reservation_id='r-y1dpjo0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2142703659',owner_user_name='tempest-AttachVolumeShelveTestJSON-2142703659-project-member',shelved_at='2023-10-30T11:02:53.835836',shelved_host='user',shelved_image_id='a668b9fb-576d-47ad-a940-ceaccf81af56'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584de218cec24240a91845deca515efa',uuid=5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converting VIF {"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG os_vif [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c1bec99-bcbf-549e-9cf3-8d30f7191345', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ca50716-19, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ca50716-19, col_values=(('qos', UUID('e53106af-bea7-4db4-b910-b482227c911e')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ca50716-19, col_values=(('external_ids', {'iface-id': '0ca50716-192b-473f-bc5a-d1136a8d52dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:c3:5f', 'vm-uuid': '5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:09 user nova-compute[74278]: INFO os_vif [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19')
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] No VIF found with MAC fa:16:3e:12:c3:5f, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:05:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-fc599134-3c2d-43ef-b0ec-18e954a38e71 req-77d09386-011b-4e06-9f40-546b83f03cd8 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fc599134-3c2d-43ef-b0ec-18e954a38e71 req-77d09386-011b-4e06-9f40-546b83f03cd8 service nova] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fc599134-3c2d-43ef-b0ec-18e954a38e71 req-77d09386-011b-4e06-9f40-546b83f03cd8 service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fc599134-3c2d-43ef-b0ec-18e954a38e71 req-77d09386-011b-4e06-9f40-546b83f03cd8 service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-fc599134-3c2d-43ef-b0ec-18e954a38e71 req-77d09386-011b-4e06-9f40-546b83f03cd8 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] No waiting events found dispatching network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:11 user nova-compute[74278]: WARNING nova.compute.manager [req-fc599134-3c2d-43ef-b0ec-18e954a38e71 req-77d09386-011b-4e06-9f40-546b83f03cd8 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received unexpected event network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 11:05:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:05:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:05:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Instance spawned successfully.
Oct 30 11:05:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-5b21c72e-9939-48cc-8977-6530551eb1f1 req-d15c8c1d-450d-475f-8f70-2f213f11e87a service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5b21c72e-9939-48cc-8977-6530551eb1f1 req-d15c8c1d-450d-475f-8f70-2f213f11e87a service nova] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5b21c72e-9939-48cc-8977-6530551eb1f1 req-d15c8c1d-450d-475f-8f70-2f213f11e87a service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5b21c72e-9939-48cc-8977-6530551eb1f1 req-d15c8c1d-450d-475f-8f70-2f213f11e87a service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-5b21c72e-9939-48cc-8977-6530551eb1f1 req-d15c8c1d-450d-475f-8f70-2f213f11e87a service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] No waiting events found dispatching network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:13 user nova-compute[74278]: WARNING nova.compute.manager [req-5b21c72e-9939-48cc-8977-6530551eb1f1 req-d15c8c1d-450d-475f-8f70-2f213f11e87a service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received unexpected event network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 11:05:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:05:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb4cf225-7fdb-410d-a73d-0686e1163832 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 33.441s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:05:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:05:17 user nova-compute[74278]: INFO nova.compute.claims [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Claim successful on node user
Oct 30 11:05:17 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:05:17 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:05:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:05:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:05:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:05:17 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:05:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG nova.policy [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '525f98e0bed241fdad3962fda627b143', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '928164ecd5c44dddb93fbecfeaa44071', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:05:18 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Creating image(s)
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "/opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "/opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.202s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk 1073741824" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.185s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:05:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Successfully created port: 9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Cannot resize image /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Ensure instance console log exists: /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Successfully updated port: 9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "refresh_cache-c5293f0b-eeaf-4180-9968-05e37211c6bd" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquired lock "refresh_cache-c5293f0b-eeaf-4180-9968-05e37211c6bd" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-549cf355-00d0-4e35-a5ab-1ad18c43bec6 req-44a2bae9-a0ec-4886-a128-202912b80d06 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Received event network-changed-9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-549cf355-00d0-4e35-a5ab-1ad18c43bec6 req-44a2bae9-a0ec-4886-a128-202912b80d06 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Refreshing instance network info cache due to event network-changed-9ccd5489-aa26-43ed-a1a5-e1984cb4300a. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-549cf355-00d0-4e35-a5ab-1ad18c43bec6 req-44a2bae9-a0ec-4886-a128-202912b80d06 service nova] Acquiring lock "refresh_cache-c5293f0b-eeaf-4180-9968-05e37211c6bd" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:05:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.network.neutron [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Updating instance_info_cache with network_info: [{"id": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "address": "fa:16:3e:1d:00:99", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ccd5489-aa", "ovs_interfaceid": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Releasing lock "refresh_cache-c5293f0b-eeaf-4180-9968-05e37211c6bd" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Instance network_info: |[{"id": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "address": "fa:16:3e:1d:00:99", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ccd5489-aa", "ovs_interfaceid": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-549cf355-00d0-4e35-a5ab-1ad18c43bec6 req-44a2bae9-a0ec-4886-a128-202912b80d06 service nova] Acquired lock "refresh_cache-c5293f0b-eeaf-4180-9968-05e37211c6bd" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.network.neutron [req-549cf355-00d0-4e35-a5ab-1ad18c43bec6 req-44a2bae9-a0ec-4886-a128-202912b80d06 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Refreshing network info cache for port 9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Start _get_guest_xml network_info=[{"id": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "address": "fa:16:3e:1d:00:99", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ccd5489-aa", "ovs_interfaceid": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:05:20 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:05:20 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1605625300',display_name='tempest-AttachVolumeTestJSON-server-1605625300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1605625300',id=33,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMEDzUr8As7KCc45r3j5vAhoATwrHi4gdgD90I7lcHvAGOWTdfJeaEiZtl+Bq90kIdrdeGWjZqWNK4nPs59MlxP1AWzYExB8MFqK6FJtDbp+dk+o+iMe7551TqONyIZAg==',key_name='tempest-keypair-1393981832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='928164ecd5c44dddb93fbecfeaa44071',ramdisk_id='',reservation_id='r-2a66r2hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2116287848',owner_user_name='tempest-AttachVolumeTestJSON-2116287848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='525f98e0bed241fdad3962fda627b143',uuid=c5293f0b-eeaf-4180-9968-05e37211c6bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "address": "fa:16:3e:1d:00:99", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ccd5489-aa", "ovs_interfaceid": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converting VIF {"id": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "address": "fa:16:3e:1d:00:99", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ccd5489-aa", "ovs_interfaceid": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:00:99,bridge_name='br-int',has_traffic_filtering=True,id=9ccd5489-aa26-43ed-a1a5-e1984cb4300a,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ccd5489-aa') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.objects.instance [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'pci_devices' on Instance uuid c5293f0b-eeaf-4180-9968-05e37211c6bd {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:05:20 user nova-compute[74278]:   <uuid>c5293f0b-eeaf-4180-9968-05e37211c6bd</uuid>
Oct 30 11:05:20 user nova-compute[74278]:   <name>instance-00000021</name>
Oct 30 11:05:20 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:05:20 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:05:20 user nova-compute[74278]:   <metadata>
Oct 30 11:05:20 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:05:20 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:05:20 user nova-compute[74278]:       <nova:name>tempest-AttachVolumeTestJSON-server-1605625300</nova:name>
Oct 30 11:05:20 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:05:20</nova:creationTime>
Oct 30 11:05:20 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:05:20 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:05:20 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:05:20 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:05:20 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:05:20 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:05:20 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:05:20 user nova-compute[74278]:       <nova:owner>
Oct 30 11:05:20 user nova-compute[74278]:         <nova:user uuid="525f98e0bed241fdad3962fda627b143">tempest-AttachVolumeTestJSON-2116287848-project-member</nova:user>
Oct 30 11:05:20 user nova-compute[74278]:         <nova:project uuid="928164ecd5c44dddb93fbecfeaa44071">tempest-AttachVolumeTestJSON-2116287848</nova:project>
Oct 30 11:05:20 user nova-compute[74278]:       </nova:owner>
Oct 30 11:05:20 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:05:20 user nova-compute[74278]:       <nova:ports>
Oct 30 11:05:20 user nova-compute[74278]:         <nova:port uuid="9ccd5489-aa26-43ed-a1a5-e1984cb4300a">
Oct 30 11:05:20 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 11:05:20 user nova-compute[74278]:         </nova:port>
Oct 30 11:05:20 user nova-compute[74278]:       </nova:ports>
Oct 30 11:05:20 user nova-compute[74278]:     </nova:instance>
Oct 30 11:05:20 user nova-compute[74278]:   </metadata>
Oct 30 11:05:20 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:05:20 user nova-compute[74278]:     <system>
Oct 30 11:05:20 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:05:20 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:05:20 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:05:20 user nova-compute[74278]:       <entry name="serial">c5293f0b-eeaf-4180-9968-05e37211c6bd</entry>
Oct 30 11:05:20 user nova-compute[74278]:       <entry name="uuid">c5293f0b-eeaf-4180-9968-05e37211c6bd</entry>
Oct 30 11:05:20 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:05:20 user nova-compute[74278]:     </system>
Oct 30 11:05:20 user nova-compute[74278]:   </sysinfo>
Oct 30 11:05:20 user nova-compute[74278]:   <os>
Oct 30 11:05:20 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:05:20 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:05:20 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:05:20 user nova-compute[74278]:   </os>
Oct 30 11:05:20 user nova-compute[74278]:   <features>
Oct 30 11:05:20 user nova-compute[74278]:     <acpi/>
Oct 30 11:05:20 user nova-compute[74278]:     <apic/>
Oct 30 11:05:20 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:05:20 user nova-compute[74278]:   </features>
Oct 30 11:05:20 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:05:20 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:05:20 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:05:20 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:05:20 user nova-compute[74278]:   </clock>
Oct 30 11:05:20 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:05:20 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:05:20 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:05:20 user nova-compute[74278]:   </cpu>
Oct 30 11:05:20 user nova-compute[74278]:   <devices>
Oct 30 11:05:20 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:05:20 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:05:20 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk"/>
Oct 30 11:05:20 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:05:20 user nova-compute[74278]:     </disk>
Oct 30 11:05:20 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:05:20 user nova-compute[74278]:       <mac address="fa:16:3e:1d:00:99"/>
Oct 30 11:05:20 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:05:20 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:05:20 user nova-compute[74278]:       <target dev="tap9ccd5489-aa"/>
Oct 30 11:05:20 user nova-compute[74278]:     </interface>
Oct 30 11:05:20 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:05:20 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/console.log" append="off"/>
Oct 30 11:05:20 user nova-compute[74278]:     </serial>
Oct 30 11:05:20 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:05:20 user nova-compute[74278]:     <video>
Oct 30 11:05:20 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:05:20 user nova-compute[74278]:     </video>
Oct 30 11:05:20 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:05:20 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:05:20 user nova-compute[74278]:     </rng>
Oct 30 11:05:20 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:05:20 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:05:20 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:05:20 user nova-compute[74278]:     </memballoon>
Oct 30 11:05:20 user nova-compute[74278]:   </devices>
Oct 30 11:05:20 user nova-compute[74278]: </domain>
Oct 30 11:05:20 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1605625300',display_name='tempest-AttachVolumeTestJSON-server-1605625300',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1605625300',id=33,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMEDzUr8As7KCc45r3j5vAhoATwrHi4gdgD90I7lcHvAGOWTdfJeaEiZtl+Bq90kIdrdeGWjZqWNK4nPs59MlxP1AWzYExB8MFqK6FJtDbp+dk+o+iMe7551TqONyIZAg==',key_name='tempest-keypair-1393981832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='928164ecd5c44dddb93fbecfeaa44071',ramdisk_id='',reservation_id='r-2a66r2hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2116287848',owner_user_name='tempest-AttachVolumeTestJSON-2116287848-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='525f98e0bed241fdad3962fda627b143',uuid=c5293f0b-eeaf-4180-9968-05e37211c6bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "address": "fa:16:3e:1d:00:99", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ccd5489-aa", "ovs_interfaceid": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converting VIF {"id": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "address": "fa:16:3e:1d:00:99", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ccd5489-aa", "ovs_interfaceid": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:00:99,bridge_name='br-int',has_traffic_filtering=True,id=9ccd5489-aa26-43ed-a1a5-e1984cb4300a,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ccd5489-aa') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG os_vif [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:00:99,bridge_name='br-int',has_traffic_filtering=True,id=9ccd5489-aa26-43ed-a1a5-e1984cb4300a,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ccd5489-aa') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '332c458a-c9cf-5546-9a04-e45bbbfb2ee1', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ccd5489-aa, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ccd5489-aa, col_values=(('qos', UUID('c83581fe-405d-4023-b2ba-c6f8a6ffa500')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ccd5489-aa, col_values=(('external_ids', {'iface-id': '9ccd5489-aa26-43ed-a1a5-e1984cb4300a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:00:99', 'vm-uuid': 'c5293f0b-eeaf-4180-9968-05e37211c6bd'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:20 user nova-compute[74278]: INFO os_vif [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:00:99,bridge_name='br-int',has_traffic_filtering=True,id=9ccd5489-aa26-43ed-a1a5-e1984cb4300a,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ccd5489-aa')
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No VIF found with MAC fa:16:3e:1d:00:99, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.network.neutron [req-549cf355-00d0-4e35-a5ab-1ad18c43bec6 req-44a2bae9-a0ec-4886-a128-202912b80d06 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Updated VIF entry in instance network info cache for port 9ccd5489-aa26-43ed-a1a5-e1984cb4300a. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG nova.network.neutron [req-549cf355-00d0-4e35-a5ab-1ad18c43bec6 req-44a2bae9-a0ec-4886-a128-202912b80d06 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Updating instance_info_cache with network_info: [{"id": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "address": "fa:16:3e:1d:00:99", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ccd5489-aa", "ovs_interfaceid": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:05:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-549cf355-00d0-4e35-a5ab-1ad18c43bec6 req-44a2bae9-a0ec-4886-a128-202912b80d06 service nova] Releasing lock "refresh_cache-c5293f0b-eeaf-4180-9968-05e37211c6bd" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:05:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-5e3868b4-fa20-4fe2-9165-86d776205ec2 req-32e6092c-f3d1-4f29-974c-a42a7b46e6c9 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Received event network-vif-plugged-9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5e3868b4-fa20-4fe2-9165-86d776205ec2 req-32e6092c-f3d1-4f29-974c-a42a7b46e6c9 service nova] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5e3868b4-fa20-4fe2-9165-86d776205ec2 req-32e6092c-f3d1-4f29-974c-a42a7b46e6c9 service nova] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5e3868b4-fa20-4fe2-9165-86d776205ec2 req-32e6092c-f3d1-4f29-974c-a42a7b46e6c9 service nova] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-5e3868b4-fa20-4fe2-9165-86d776205ec2 req-32e6092c-f3d1-4f29-974c-a42a7b46e6c9 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] No waiting events found dispatching network-vif-plugged-9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:21 user nova-compute[74278]: WARNING nova.compute.manager [req-5e3868b4-fa20-4fe2-9165-86d776205ec2 req-32e6092c-f3d1-4f29-974c-a42a7b46e6c9 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Received unexpected event network-vif-plugged-9ccd5489-aa26-43ed-a1a5-e1984cb4300a for instance with vm_state building and task_state spawning.
Oct 30 11:05:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:05:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Instance spawned successfully.
Oct 30 11:05:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:05:23 user nova-compute[74278]: INFO nova.compute.manager [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Took 5.76 seconds to spawn the instance on the hypervisor.
Oct 30 11:05:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-8b0360e8-88b7-4291-818f-80ee8e3a48e2 req-0a685fd0-3fdd-4d48-8546-ab7b10acc8b7 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Received event network-vif-plugged-9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8b0360e8-88b7-4291-818f-80ee8e3a48e2 req-0a685fd0-3fdd-4d48-8546-ab7b10acc8b7 service nova] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8b0360e8-88b7-4291-818f-80ee8e3a48e2 req-0a685fd0-3fdd-4d48-8546-ab7b10acc8b7 service nova] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8b0360e8-88b7-4291-818f-80ee8e3a48e2 req-0a685fd0-3fdd-4d48-8546-ab7b10acc8b7 service nova] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-8b0360e8-88b7-4291-818f-80ee8e3a48e2 req-0a685fd0-3fdd-4d48-8546-ab7b10acc8b7 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] No waiting events found dispatching network-vif-plugged-9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:23 user nova-compute[74278]: WARNING nova.compute.manager [req-8b0360e8-88b7-4291-818f-80ee8e3a48e2 req-0a685fd0-3fdd-4d48-8546-ab7b10acc8b7 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Received unexpected event network-vif-plugged-9ccd5489-aa26-43ed-a1a5-e1984cb4300a for instance with vm_state building and task_state spawning.
Oct 30 11:05:24 user nova-compute[74278]: INFO nova.compute.manager [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Took 6.63 seconds to build instance.
Oct 30 11:05:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c41cbc44-2b2e-49e9-9469-555b72d65ec3 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.739s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Acquiring lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Acquiring lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:24 user nova-compute[74278]: INFO nova.compute.manager [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Terminating instance
Oct 30 11:05:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:05:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:25 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Instance destroyed successfully.
Oct 30 11:05:25 user nova-compute[74278]: DEBUG nova.objects.instance [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lazy-loading 'resources' on Instance uuid a30a0e67-5274-4f10-9f88-038dfe0e4fbf {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1254837131',display_name='tempest-VolumesActionsTest-instance-1254837131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1254837131',id=31,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:03:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='513ca266d91348d69eff751ba2e9293d',ramdisk_id='',reservation_id='r-olkwe2td',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-309200444',owner_user_name='tempest-VolumesActionsTest-309200444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:03:22Z,user_data=None,user_id='352cbfc844d24e1a8a88d8d5337fe86c',uuid=a30a0e67-5274-4f10-9f88-038dfe0e4fbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "address": "fa:16:3e:b5:89:df", "network": {"id": "d308659f-8977-4087-a7a5-1996c6c7879c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-835205329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513ca266d91348d69eff751ba2e9293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc80ae1-59", "ovs_interfaceid": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Converting VIF {"id": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "address": "fa:16:3e:b5:89:df", "network": {"id": "d308659f-8977-4087-a7a5-1996c6c7879c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-835205329-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "513ca266d91348d69eff751ba2e9293d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dc80ae1-59", "ovs_interfaceid": "1dc80ae1-599d-490f-85c2-ebef7f7576be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:89:df,bridge_name='br-int',has_traffic_filtering=True,id=1dc80ae1-599d-490f-85c2-ebef7f7576be,network=Network(d308659f-8977-4087-a7a5-1996c6c7879c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc80ae1-59') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG os_vif [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:89:df,bridge_name='br-int',has_traffic_filtering=True,id=1dc80ae1-599d-490f-85c2-ebef7f7576be,network=Network(d308659f-8977-4087-a7a5-1996c6c7879c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc80ae1-59') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dc80ae1-59, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f295103f-52a6-439a-81ba-a5349a985f1c) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:25 user nova-compute[74278]: INFO os_vif [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:89:df,bridge_name='br-int',has_traffic_filtering=True,id=1dc80ae1-599d-490f-85c2-ebef7f7576be,network=Network(d308659f-8977-4087-a7a5-1996c6c7879c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dc80ae1-59')
Oct 30 11:05:25 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Deleting instance files /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf_del
Oct 30 11:05:25 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Deletion of /opt/stack/data/nova/instances/a30a0e67-5274-4f10-9f88-038dfe0e4fbf_del complete
Oct 30 11:05:25 user nova-compute[74278]: INFO nova.compute.manager [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 30 11:05:25 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:05:25 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:05:25 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Took 0.69 seconds to deallocate network for instance.
Oct 30 11:05:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-d64ae240-18a0-47a8-aa94-523bbd8e3cb4 req-aae2f871-d599-47f6-ac67-c985c3964b72 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Received event network-vif-deleted-1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-64a87658-be11-4ad2-9590-e2353e096c24 req-6b4f4c91-7f6d-4edf-94db-6fb706db5596 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Received event network-vif-unplugged-1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-64a87658-be11-4ad2-9590-e2353e096c24 req-6b4f4c91-7f6d-4edf-94db-6fb706db5596 service nova] Acquiring lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-64a87658-be11-4ad2-9590-e2353e096c24 req-6b4f4c91-7f6d-4edf-94db-6fb706db5596 service nova] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-64a87658-be11-4ad2-9590-e2353e096c24 req-6b4f4c91-7f6d-4edf-94db-6fb706db5596 service nova] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-64a87658-be11-4ad2-9590-e2353e096c24 req-6b4f4c91-7f6d-4edf-94db-6fb706db5596 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] No waiting events found dispatching network-vif-unplugged-1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-64a87658-be11-4ad2-9590-e2353e096c24 req-6b4f4c91-7f6d-4edf-94db-6fb706db5596 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Received event network-vif-unplugged-1dc80ae1-599d-490f-85c2-ebef7f7576be for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-64a87658-be11-4ad2-9590-e2353e096c24 req-6b4f4c91-7f6d-4edf-94db-6fb706db5596 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Received event network-vif-plugged-1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-64a87658-be11-4ad2-9590-e2353e096c24 req-6b4f4c91-7f6d-4edf-94db-6fb706db5596 service nova] Acquiring lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-64a87658-be11-4ad2-9590-e2353e096c24 req-6b4f4c91-7f6d-4edf-94db-6fb706db5596 service nova] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-64a87658-be11-4ad2-9590-e2353e096c24 req-6b4f4c91-7f6d-4edf-94db-6fb706db5596 service nova] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-64a87658-be11-4ad2-9590-e2353e096c24 req-6b4f4c91-7f6d-4edf-94db-6fb706db5596 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] No waiting events found dispatching network-vif-plugged-1dc80ae1-599d-490f-85c2-ebef7f7576be {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:26 user nova-compute[74278]: WARNING nova.compute.manager [req-64a87658-be11-4ad2-9590-e2353e096c24 req-6b4f4c91-7f6d-4edf-94db-6fb706db5596 service nova] [instance: a30a0e67-5274-4f10-9f88-038dfe0e4fbf] Received unexpected event network-vif-plugged-1dc80ae1-599d-490f-85c2-ebef7f7576be for instance with vm_state active and task_state deleting.
Oct 30 11:05:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:05:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:26 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Deleted allocations for instance a30a0e67-5274-4f10-9f88-038dfe0e4fbf
Oct 30 11:05:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-672ed868-82e2-42c1-8203-c8488fdb1b62 tempest-VolumesActionsTest-309200444 tempest-VolumesActionsTest-309200444-project-member] Lock "a30a0e67-5274-4f10-9f88-038dfe0e4fbf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.303s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:28 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:05:28 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:05:29 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:05:29 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:05:29 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 11:05:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:05:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:05:29 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:05:29 user nova-compute[74278]: DEBUG nova.objects.instance [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lazy-loading 'info_cache' on Instance uuid da67673a-dbe6-419f-8547-5ca730f14003 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:05:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:30 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Updating instance_info_cache with network_info: [{"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:05:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:05:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:05:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:05:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:05:31 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:05:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:31 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:05:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:05:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:05:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:35 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:05:35 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7275MB free_disk=24.765060424804688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 64287717-7d3b-4087-aedf-faf87be774a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2b8efca4-cec4-4179-99af-92172f9b8a06 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 3d76b06b-9009-4879-83f4-819b1d20ce6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 6d868c1e-1985-48b6-a881-4d17b364701a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance f35f1e59-504e-42d2-9d50-f14a32844bdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance c5293f0b-eeaf-4180-9968-05e37211c6bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:05:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:05:36 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:05:36 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:05:36 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:05:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "a5826048-2aeb-49ed-ac49-7d2327d70e92" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:05:37 user nova-compute[74278]: INFO nova.compute.claims [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Claim successful on node user
Oct 30 11:05:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:05:37 user nova-compute[74278]: DEBUG nova.network.neutron [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:05:37 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:05:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG nova.policy [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a8ce768d96b4d42ae87c9e3af6c4592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6516f9ae7cc1453db5bea067d108eed1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG nova.compute.manager [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:05:38 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Creating image(s)
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "/opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "/opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.022s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.187s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG nova.network.neutron [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Successfully created port: 6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk 1073741824" returned: 0 in 0.070s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Cannot resize image /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Ensure instance console log exists: /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.network.neutron [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Successfully updated port: 6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "refresh_cache-a5826048-2aeb-49ed-ac49-7d2327d70e92" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquired lock "refresh_cache-a5826048-2aeb-49ed-ac49-7d2327d70e92" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.network.neutron [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.compute.manager [req-d6b7313b-0aca-4a57-934c-cc2ef1ed8712 req-4d466091-eaba-4a33-aad2-2b8e7c363f54 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Received event network-changed-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.compute.manager [req-d6b7313b-0aca-4a57-934c-cc2ef1ed8712 req-4d466091-eaba-4a33-aad2-2b8e7c363f54 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Refreshing instance network info cache due to event network-changed-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d6b7313b-0aca-4a57-934c-cc2ef1ed8712 req-4d466091-eaba-4a33-aad2-2b8e7c363f54 service nova] Acquiring lock "refresh_cache-a5826048-2aeb-49ed-ac49-7d2327d70e92" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.network.neutron [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.network.neutron [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Updating instance_info_cache with network_info: [{"id": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "address": "fa:16:3e:61:ae:96", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0fbbe9-e7", "ovs_interfaceid": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Releasing lock "refresh_cache-a5826048-2aeb-49ed-ac49-7d2327d70e92" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.compute.manager [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Instance network_info: |[{"id": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "address": "fa:16:3e:61:ae:96", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0fbbe9-e7", "ovs_interfaceid": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d6b7313b-0aca-4a57-934c-cc2ef1ed8712 req-4d466091-eaba-4a33-aad2-2b8e7c363f54 service nova] Acquired lock "refresh_cache-a5826048-2aeb-49ed-ac49-7d2327d70e92" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.network.neutron [req-d6b7313b-0aca-4a57-934c-cc2ef1ed8712 req-4d466091-eaba-4a33-aad2-2b8e7c363f54 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Refreshing network info cache for port 6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Start _get_guest_xml network_info=[{"id": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "address": "fa:16:3e:61:ae:96", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0fbbe9-e7", "ovs_interfaceid": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:05:39 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:05:39 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:05:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1740467051',display_name='tempest-VolumesActionsTest-instance-1740467051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1740467051',id=34,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6516f9ae7cc1453db5bea067d108eed1',ramdisk_id='',reservation_id='r-8s3rcw3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1938085894',owner_user_name='tempest-VolumesActionsTest-1938085894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:05:38Z,user_data=None,user_id='2a8ce768d96b4d42ae87c9e3af6c4592',uuid=a5826048-2aeb-49ed-ac49-7d2327d70e92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "address": "fa:16:3e:61:ae:96", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0fbbe9-e7", "ovs_interfaceid": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Converting VIF {"id": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "address": "fa:16:3e:61:ae:96", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0fbbe9-e7", "ovs_interfaceid": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=6d0fbbe9-e748-418c-b2ad-41fd7e4a4048,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0fbbe9-e7') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.objects.instance [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lazy-loading 'pci_devices' on Instance uuid a5826048-2aeb-49ed-ac49-7d2327d70e92 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:05:39 user nova-compute[74278]:   <uuid>a5826048-2aeb-49ed-ac49-7d2327d70e92</uuid>
Oct 30 11:05:39 user nova-compute[74278]:   <name>instance-00000022</name>
Oct 30 11:05:39 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:05:39 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:05:39 user nova-compute[74278]:   <metadata>
Oct 30 11:05:39 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:05:39 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:05:39 user nova-compute[74278]:       <nova:name>tempest-VolumesActionsTest-instance-1740467051</nova:name>
Oct 30 11:05:39 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:05:39</nova:creationTime>
Oct 30 11:05:39 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:05:39 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:05:39 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:05:39 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:05:39 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:05:39 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:05:39 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:05:39 user nova-compute[74278]:       <nova:owner>
Oct 30 11:05:39 user nova-compute[74278]:         <nova:user uuid="2a8ce768d96b4d42ae87c9e3af6c4592">tempest-VolumesActionsTest-1938085894-project-member</nova:user>
Oct 30 11:05:39 user nova-compute[74278]:         <nova:project uuid="6516f9ae7cc1453db5bea067d108eed1">tempest-VolumesActionsTest-1938085894</nova:project>
Oct 30 11:05:39 user nova-compute[74278]:       </nova:owner>
Oct 30 11:05:39 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:05:39 user nova-compute[74278]:       <nova:ports>
Oct 30 11:05:39 user nova-compute[74278]:         <nova:port uuid="6d0fbbe9-e748-418c-b2ad-41fd7e4a4048">
Oct 30 11:05:39 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 11:05:39 user nova-compute[74278]:         </nova:port>
Oct 30 11:05:39 user nova-compute[74278]:       </nova:ports>
Oct 30 11:05:39 user nova-compute[74278]:     </nova:instance>
Oct 30 11:05:39 user nova-compute[74278]:   </metadata>
Oct 30 11:05:39 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:05:39 user nova-compute[74278]:     <system>
Oct 30 11:05:39 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:05:39 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:05:39 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:05:39 user nova-compute[74278]:       <entry name="serial">a5826048-2aeb-49ed-ac49-7d2327d70e92</entry>
Oct 30 11:05:39 user nova-compute[74278]:       <entry name="uuid">a5826048-2aeb-49ed-ac49-7d2327d70e92</entry>
Oct 30 11:05:39 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:05:39 user nova-compute[74278]:     </system>
Oct 30 11:05:39 user nova-compute[74278]:   </sysinfo>
Oct 30 11:05:39 user nova-compute[74278]:   <os>
Oct 30 11:05:39 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:05:39 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:05:39 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:05:39 user nova-compute[74278]:   </os>
Oct 30 11:05:39 user nova-compute[74278]:   <features>
Oct 30 11:05:39 user nova-compute[74278]:     <acpi/>
Oct 30 11:05:39 user nova-compute[74278]:     <apic/>
Oct 30 11:05:39 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:05:39 user nova-compute[74278]:   </features>
Oct 30 11:05:39 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:05:39 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:05:39 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:05:39 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:05:39 user nova-compute[74278]:   </clock>
Oct 30 11:05:39 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:05:39 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:05:39 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:05:39 user nova-compute[74278]:   </cpu>
Oct 30 11:05:39 user nova-compute[74278]:   <devices>
Oct 30 11:05:39 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:05:39 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:05:39 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk"/>
Oct 30 11:05:39 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:05:39 user nova-compute[74278]:     </disk>
Oct 30 11:05:39 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:05:39 user nova-compute[74278]:       <mac address="fa:16:3e:61:ae:96"/>
Oct 30 11:05:39 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:05:39 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:05:39 user nova-compute[74278]:       <target dev="tap6d0fbbe9-e7"/>
Oct 30 11:05:39 user nova-compute[74278]:     </interface>
Oct 30 11:05:39 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:05:39 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/console.log" append="off"/>
Oct 30 11:05:39 user nova-compute[74278]:     </serial>
Oct 30 11:05:39 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:05:39 user nova-compute[74278]:     <video>
Oct 30 11:05:39 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:05:39 user nova-compute[74278]:     </video>
Oct 30 11:05:39 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:05:39 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:05:39 user nova-compute[74278]:     </rng>
Oct 30 11:05:39 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:05:39 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:05:39 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:05:39 user nova-compute[74278]:     </memballoon>
Oct 30 11:05:39 user nova-compute[74278]:   </devices>
Oct 30 11:05:39 user nova-compute[74278]: </domain>
Oct 30 11:05:39 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:05:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1740467051',display_name='tempest-VolumesActionsTest-instance-1740467051',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1740467051',id=34,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6516f9ae7cc1453db5bea067d108eed1',ramdisk_id='',reservation_id='r-8s3rcw3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1938085894',owner_user_name='tempest-VolumesActionsTest-1938085894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:05:38Z,user_data=None,user_id='2a8ce768d96b4d42ae87c9e3af6c4592',uuid=a5826048-2aeb-49ed-ac49-7d2327d70e92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "address": "fa:16:3e:61:ae:96", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0fbbe9-e7", "ovs_interfaceid": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Converting VIF {"id": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "address": "fa:16:3e:61:ae:96", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0fbbe9-e7", "ovs_interfaceid": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=6d0fbbe9-e748-418c-b2ad-41fd7e4a4048,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0fbbe9-e7') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG os_vif [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=6d0fbbe9-e748-418c-b2ad-41fd7e4a4048,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0fbbe9-e7') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '977acaa9-70bc-5688-ad43-04687dee0341', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d0fbbe9-e7, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d0fbbe9-e7, col_values=(('qos', UUID('940e1e5a-3cf8-4f16-9f7c-dc069c40ba9b')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d0fbbe9-e7, col_values=(('external_ids', {'iface-id': '6d0fbbe9-e748-418c-b2ad-41fd7e4a4048', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:ae:96', 'vm-uuid': 'a5826048-2aeb-49ed-ac49-7d2327d70e92'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:39 user nova-compute[74278]: INFO os_vif [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=6d0fbbe9-e748-418c-b2ad-41fd7e4a4048,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0fbbe9-e7')
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] No VIF found with MAC fa:16:3e:61:ae:96, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.network.neutron [req-d6b7313b-0aca-4a57-934c-cc2ef1ed8712 req-4d466091-eaba-4a33-aad2-2b8e7c363f54 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Updated VIF entry in instance network info cache for port 6d0fbbe9-e748-418c-b2ad-41fd7e4a4048. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG nova.network.neutron [req-d6b7313b-0aca-4a57-934c-cc2ef1ed8712 req-4d466091-eaba-4a33-aad2-2b8e7c363f54 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Updating instance_info_cache with network_info: [{"id": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "address": "fa:16:3e:61:ae:96", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0fbbe9-e7", "ovs_interfaceid": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d6b7313b-0aca-4a57-934c-cc2ef1ed8712 req-4d466091-eaba-4a33-aad2-2b8e7c363f54 service nova] Releasing lock "refresh_cache-a5826048-2aeb-49ed-ac49-7d2327d70e92" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:05:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-bdba441d-87a3-44fb-a010-c3d383045ef2 req-fb30c6a8-82a1-400a-8451-c695de886ae2 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Received event network-vif-plugged-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bdba441d-87a3-44fb-a010-c3d383045ef2 req-fb30c6a8-82a1-400a-8451-c695de886ae2 service nova] Acquiring lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bdba441d-87a3-44fb-a010-c3d383045ef2 req-fb30c6a8-82a1-400a-8451-c695de886ae2 service nova] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bdba441d-87a3-44fb-a010-c3d383045ef2 req-fb30c6a8-82a1-400a-8451-c695de886ae2 service nova] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-bdba441d-87a3-44fb-a010-c3d383045ef2 req-fb30c6a8-82a1-400a-8451-c695de886ae2 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] No waiting events found dispatching network-vif-plugged-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:41 user nova-compute[74278]: WARNING nova.compute.manager [req-bdba441d-87a3-44fb-a010-c3d383045ef2 req-fb30c6a8-82a1-400a-8451-c695de886ae2 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Received unexpected event network-vif-plugged-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 for instance with vm_state building and task_state spawning.
Oct 30 11:05:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:41 user nova-compute[74278]: INFO nova.compute.manager [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Terminating instance
Oct 30 11:05:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:42 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Instance destroyed successfully.
Oct 30 11:05:42 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lazy-loading 'resources' on Instance uuid 3d76b06b-9009-4879-83f4-819b1d20ce6c {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:01:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-248564876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1641223937',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHVmrqblopLInY1Wvk20+mn5oY9HK3qJoDsTdzD86gNKR60O24Sw37vqqe1SrB61PQcGQ4FQ4hLz1IfnqJniiFuJlMlaNcPIwOFFcbpXS/Op3g50/gRu7VGHSf0Wg5YEw==',key_name='tempest-keypair-1295466818',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:04:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e2c85eda9534f06bd5d7db1300d1f73',ramdisk_id='',reservation_id='r-mt0ozl4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-632878584',owner_user_name='tempest-ServerActionsV293TestJSON-632878584-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:04:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e7bb5f85c254f3d9febe9dc037a8459',uuid=3d76b06b-9009-4879-83f4-819b1d20ce6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Converting VIF {"id": "8fac0256-08e9-4391-9b63-41b420e15539", "address": "fa:16:3e:9c:e3:8e", "network": {"id": "b73c7a25-be96-4e54-afd1-77a55d5eef5a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2045140036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e2c85eda9534f06bd5d7db1300d1f73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fac0256-08", "ovs_interfaceid": "8fac0256-08e9-4391-9b63-41b420e15539", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_vif [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fac0256-08, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=714e0555-7eca-4e7c-ae54-37fd8aedebd6) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:42 user nova-compute[74278]: INFO os_vif [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:e3:8e,bridge_name='br-int',has_traffic_filtering=True,id=8fac0256-08e9-4391-9b63-41b420e15539,network=Network(b73c7a25-be96-4e54-afd1-77a55d5eef5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fac0256-08')
Oct 30 11:05:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWlZnusY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:05:42 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1bbc7b-cac6-48fa-9d00-3f77e731732e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:05:42 user nova-compute[74278]: No targets found.
Oct 30 11:05:42 user nova-compute[74278]: iSNS:
Oct 30 11:05:42 user nova-compute[74278]: No targets found.
Oct 30 11:05:42 user nova-compute[74278]: STATIC:
Oct 30 11:05:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2
Oct 30 11:05:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:05:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:05:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3
Oct 30 11:05:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:05:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:05:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:05:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:05:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:05:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93
Oct 30 11:05:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:05:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:05:42 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce
Oct 30 11:05:42 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:05:42 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:05:42 user nova-compute[74278]: FIRMWARE:
Oct 30 11:05:42 user nova-compute[74278]: No targets found.
Oct 30 11:05:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:05:42 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:05:42 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c0ff1a-39a8-4ba5-8864-2491e7159851]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[599287c4-0f03-4696-91dd-497ae627575a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:05:42 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:05:42 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:05:42 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:05:42 user nova-compute[74278]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)
Oct 30 11:05:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:05:42 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:05:42 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:05:42 user nova-compute[74278]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce (non-flash)
Oct 30 11:05:42 user nova-compute[74278]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)
Oct 30 11:05:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c115cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce'): ({'sdd'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Removing single pathed devices sdd {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8d8d95-4f56-4444-970c-59ec9f7b1a98]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[448db90d-b323-4298-964f-36de709334b9]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Flushing IO for device /dev/sdd {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f6e208-6764-43ef-97a4-572eb6071aae]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[de11b220-2d3b-4b7f-bde3-02a77a78a1df]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5ca21a8-b0ad2eb8b004dbf2', '/dev/disk/by-id/scsi-26230616432656238', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5ca21a8') {{(pid=85487) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[326940c0-8f50-4bbb-a1ff-1fbc4d93eb1e]: (4, None) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c58dc2-7c27-47b1-ac11-cc6ec10f9586]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[963a372d-0f3a-4652-bdbd-17c7caaf4157]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260]
Oct 30 11:05:42 user nova-compute[74278]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce, portal: 172.16.0.220,3260] successful.
Oct 30 11:05:42 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cafaf0-7ce3-4156-a3e8-272d31df1897]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] <== disconnect_volume: return (357ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:05:42 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Deleting instance files /opt/stack/data/nova/instances/3d76b06b-9009-4879-83f4-819b1d20ce6c_del
Oct 30 11:05:42 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Deletion of /opt/stack/data/nova/instances/3d76b06b-9009-4879-83f4-819b1d20ce6c_del complete
Oct 30 11:05:42 user nova-compute[74278]: INFO nova.compute.manager [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 30 11:05:42 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.compute.manager [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:05:43 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Instance spawned successfully.
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:43 user nova-compute[74278]: INFO nova.compute.manager [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Took 5.03 seconds to spawn the instance on the hypervisor.
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.compute.manager [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Received event network-vif-plugged-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] Acquiring lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] No waiting events found dispatching network-vif-plugged-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:43 user nova-compute[74278]: WARNING nova.compute.manager [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Received unexpected event network-vif-plugged-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 for instance with vm_state building and task_state spawning.
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event network-vif-unplugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] No waiting events found dispatching network-vif-unplugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event network-vif-unplugged-8fac0256-08e9-4391-9b63-41b420e15539 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] Acquiring lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] No waiting events found dispatching network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:05:43 user nova-compute[74278]: WARNING nova.compute.manager [req-1d7abc2c-9877-4011-a186-7986cdce1c6b req-ac56287e-ed50-48c7-bd8b-f1b6cddd6a5b service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received unexpected event network-vif-plugged-8fac0256-08e9-4391-9b63-41b420e15539 for instance with vm_state active and task_state deleting.
Oct 30 11:05:43 user nova-compute[74278]: INFO nova.compute.manager [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Took 5.90 seconds to build instance.
Oct 30 11:05:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-63098092-1500-4228-8662-3ea08bb9511f tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.058s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:05:43 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Took 0.85 seconds to deallocate network for instance.
Oct 30 11:05:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-f1f591eb-7568-4d9d-a8e7-6ab2d609d4fd req-f8efab8c-e8a9-4b10-a434-8851af27d52e service nova] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Received event network-vif-deleted-8fac0256-08e9-4391-9b63-41b420e15539 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:05:44 user nova-compute[74278]: INFO nova.compute.manager [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Took 0.95 seconds to detach 1 volumes for instance.
Oct 30 11:05:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] [instance: 3d76b06b-9009-4879-83f4-819b1d20ce6c] Deleting volume: c0d77d8d-1f5f-43ba-9a81-b9d6e49302ce {{(pid=74278) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 11:05:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:45 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:05:45 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:05:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:45 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Deleted allocations for instance 3d76b06b-9009-4879-83f4-819b1d20ce6c
Oct 30 11:05:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a82d2ca-e868-4ab4-b54c-10aa0852e5d5 tempest-ServerActionsV293TestJSON-632878584 tempest-ServerActionsV293TestJSON-632878584-project-member] Lock "3d76b06b-9009-4879-83f4-819b1d20ce6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.689s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Acquiring lock "2b8efca4-cec4-4179-99af-92172f9b8a06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Acquiring lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:05:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:05:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:05:59 user nova-compute[74278]: INFO nova.compute.manager [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Terminating instance
Oct 30 11:05:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:05:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:05:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-48936e39-04ca-4724-b348-4be035b19aea req-5dece869-b827-4f4b-8ce9-d8932b3d239b service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Received event network-vif-unplugged-f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-48936e39-04ca-4724-b348-4be035b19aea req-5dece869-b827-4f4b-8ce9-d8932b3d239b service nova] Acquiring lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-48936e39-04ca-4724-b348-4be035b19aea req-5dece869-b827-4f4b-8ce9-d8932b3d239b service nova] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-48936e39-04ca-4724-b348-4be035b19aea req-5dece869-b827-4f4b-8ce9-d8932b3d239b service nova] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-48936e39-04ca-4724-b348-4be035b19aea req-5dece869-b827-4f4b-8ce9-d8932b3d239b service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] No waiting events found dispatching network-vif-unplugged-f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-48936e39-04ca-4724-b348-4be035b19aea req-5dece869-b827-4f4b-8ce9-d8932b3d239b service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Received event network-vif-unplugged-f802cc84-3654-430b-8c5f-c862a7bababc for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:06:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Instance destroyed successfully.
Oct 30 11:06:00 user nova-compute[74278]: DEBUG nova.objects.instance [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lazy-loading 'resources' on Instance uuid 2b8efca4-cec4-4179-99af-92172f9b8a06 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:58:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-443132128',display_name='tempest-ServerStableDeviceRescueTest-server-443132128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-443132128',id=23,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNnzdRxyG0AUok1KF+Au2eK/kJXGgVup8cs2DNmJ/l43OxgvfB0BCM4cNTWb4+G9dzh39Vb/F6+1zeA1AK7B+SJHhX6mcVnlhNBg8iSQFvFFvRo7u7peXBjTuxJGoPabUQ==',key_name='tempest-keypair-1062601204',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:59:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='111e751160ba47198f17085be7a3214d',ramdisk_id='',reservation_id='r-r70rzbh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2138516490',owner_user_name='tempest-ServerStableDeviceRescueTest-2138516490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67d961bd648748fbb0c9371099737703',uuid=2b8efca4-cec4-4179-99af-92172f9b8a06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f802cc84-3654-430b-8c5f-c862a7bababc", "address": "fa:16:3e:f4:6a:52", "network": {"id": "29f5a489-9312-45e1-9c8b-4d2ce9926744", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-775167779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111e751160ba47198f17085be7a3214d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf802cc84-36", "ovs_interfaceid": "f802cc84-3654-430b-8c5f-c862a7bababc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Converting VIF {"id": "f802cc84-3654-430b-8c5f-c862a7bababc", "address": "fa:16:3e:f4:6a:52", "network": {"id": "29f5a489-9312-45e1-9c8b-4d2ce9926744", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-775167779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "111e751160ba47198f17085be7a3214d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf802cc84-36", "ovs_interfaceid": "f802cc84-3654-430b-8c5f-c862a7bababc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6a:52,bridge_name='br-int',has_traffic_filtering=True,id=f802cc84-3654-430b-8c5f-c862a7bababc,network=Network(29f5a489-9312-45e1-9c8b-4d2ce9926744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf802cc84-36') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG os_vif [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6a:52,bridge_name='br-int',has_traffic_filtering=True,id=f802cc84-3654-430b-8c5f-c862a7bababc,network=Network(29f5a489-9312-45e1-9c8b-4d2ce9926744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf802cc84-36') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf802cc84-36, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1d55d41-66cf-4ed4-9dd2-a52049174c17) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:00 user nova-compute[74278]: INFO os_vif [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:6a:52,bridge_name='br-int',has_traffic_filtering=True,id=f802cc84-3654-430b-8c5f-c862a7bababc,network=Network(29f5a489-9312-45e1-9c8b-4d2ce9926744),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf802cc84-36')
Oct 30 11:06:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Deleting instance files /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06_del
Oct 30 11:06:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Deletion of /opt/stack/data/nova/instances/2b8efca4-cec4-4179-99af-92172f9b8a06_del complete
Oct 30 11:06:00 user nova-compute[74278]: INFO nova.compute.manager [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 30 11:06:00 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:06:00 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:06:01 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:06:01 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Took 0.76 seconds to deallocate network for instance.
Oct 30 11:06:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-b4a924c2-a43b-4d18-961c-748a0022b600 req-c9f658d5-4a54-4eb4-9cc1-422e4c6027ff service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Received event network-vif-deleted-f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:06:01 user nova-compute[74278]: INFO nova.compute.manager [req-b4a924c2-a43b-4d18-961c-748a0022b600 req-c9f658d5-4a54-4eb4-9cc1-422e4c6027ff service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Neutron deleted interface f802cc84-3654-430b-8c5f-c862a7bababc; detaching it from the instance and deleting it from the info cache
Oct 30 11:06:01 user nova-compute[74278]: DEBUG nova.network.neutron [req-b4a924c2-a43b-4d18-961c-748a0022b600 req-c9f658d5-4a54-4eb4-9cc1-422e4c6027ff service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:06:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-b4a924c2-a43b-4d18-961c-748a0022b600 req-c9f658d5-4a54-4eb4-9cc1-422e4c6027ff service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Detach interface failed, port_id=f802cc84-3654-430b-8c5f-c862a7bababc, reason: Instance 2b8efca4-cec4-4179-99af-92172f9b8a06 could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:06:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:01 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:06:01 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:06:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:02 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Deleted allocations for instance 2b8efca4-cec4-4179-99af-92172f9b8a06
Oct 30 11:06:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ba7a3705-c1eb-4515-9ce2-80b088269d28 tempest-ServerStableDeviceRescueTest-2138516490 tempest-ServerStableDeviceRescueTest-2138516490-project-member] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.302s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-e546e1ca-117c-4d8f-9d2e-567565602534 req-8516440c-e312-4ba2-9b1d-3703061d04d8 service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Received event network-vif-plugged-f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:06:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e546e1ca-117c-4d8f-9d2e-567565602534 req-8516440c-e312-4ba2-9b1d-3703061d04d8 service nova] Acquiring lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e546e1ca-117c-4d8f-9d2e-567565602534 req-8516440c-e312-4ba2-9b1d-3703061d04d8 service nova] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e546e1ca-117c-4d8f-9d2e-567565602534 req-8516440c-e312-4ba2-9b1d-3703061d04d8 service nova] Lock "2b8efca4-cec4-4179-99af-92172f9b8a06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-e546e1ca-117c-4d8f-9d2e-567565602534 req-8516440c-e312-4ba2-9b1d-3703061d04d8 service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] No waiting events found dispatching network-vif-plugged-f802cc84-3654-430b-8c5f-c862a7bababc {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:06:02 user nova-compute[74278]: WARNING nova.compute.manager [req-e546e1ca-117c-4d8f-9d2e-567565602534 req-8516440c-e312-4ba2-9b1d-3703061d04d8 service nova] [instance: 2b8efca4-cec4-4179-99af-92172f9b8a06] Received unexpected event network-vif-plugged-f802cc84-3654-430b-8c5f-c862a7bababc for instance with vm_state deleted and task_state None.
Oct 30 11:06:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-7dd1993f-015a-4d81-a743-544f1588c605 req-3fb18a21-8f7b-4076-ae8f-2888db291036 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Received event network-changed-333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:06:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-7dd1993f-015a-4d81-a743-544f1588c605 req-3fb18a21-8f7b-4076-ae8f-2888db291036 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Refreshing instance network info cache due to event network-changed-333767b9-356d-47ab-a72e-6ef22262c57f. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:06:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7dd1993f-015a-4d81-a743-544f1588c605 req-3fb18a21-8f7b-4076-ae8f-2888db291036 service nova] Acquiring lock "refresh_cache-f35f1e59-504e-42d2-9d50-f14a32844bdb" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:06:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7dd1993f-015a-4d81-a743-544f1588c605 req-3fb18a21-8f7b-4076-ae8f-2888db291036 service nova] Acquired lock "refresh_cache-f35f1e59-504e-42d2-9d50-f14a32844bdb" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:06:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-7dd1993f-015a-4d81-a743-544f1588c605 req-3fb18a21-8f7b-4076-ae8f-2888db291036 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Refreshing network info cache for port 333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG nova.network.neutron [req-7dd1993f-015a-4d81-a743-544f1588c605 req-3fb18a21-8f7b-4076-ae8f-2888db291036 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Updated VIF entry in instance network info cache for port 333767b9-356d-47ab-a72e-6ef22262c57f. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG nova.network.neutron [req-7dd1993f-015a-4d81-a743-544f1588c605 req-3fb18a21-8f7b-4076-ae8f-2888db291036 service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Updating instance_info_cache with network_info: [{"id": "333767b9-356d-47ab-a72e-6ef22262c57f", "address": "fa:16:3e:6f:fb:3d", "network": {"id": "4bcb592e-43df-4f4a-bb74-03b24c1795ef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1818877804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f53b83164364a24a93f397e578d1ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333767b9-35", "ovs_interfaceid": "333767b9-356d-47ab-a72e-6ef22262c57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7dd1993f-015a-4d81-a743-544f1588c605 req-3fb18a21-8f7b-4076-ae8f-2888db291036 service nova] Releasing lock "refresh_cache-f35f1e59-504e-42d2-9d50-f14a32844bdb" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lazy-loading 'flavor' on Instance uuid f35f1e59-504e-42d2-9d50-f14a32844bdb {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:16 user nova-compute[74278]: INFO nova.compute.manager [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Attaching volume 1487bc7d-c642-4d94-b6ca-265826cb91b0 to /dev/vdb
Oct 30 11:06:16 user nova-compute[74278]: DEBUG os_brick.utils [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[afee774c-22fd-4800-ab14-8c79d576bc09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[19773d7f-151c-4404-9e20-73b1cd6743ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.042s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbda751-e437-412b-b3ef-45b3a806476b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5da4f4-677f-4d6d-a8b2-4ee66a1e610c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:06:17 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:06:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[321694f3-9919-48c7-bb95-ce053636af52]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:06:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:06:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:06:17 user nova-compute[74278]: DEBUG os_brick.utils [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:06:17 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Updating existing volume attachment record: 67c1b725-fb54-4068-8d86-b9c2ed61513b {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:06:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:22 user nova-compute[74278]: INFO nova.compute.manager [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Detaching volume 5feb7441-95f8-4d76-a055-1bd22f0678f2
Oct 30 11:06:22 user nova-compute[74278]: INFO nova.virt.block_device [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Attempting to driver detach volume 5feb7441-95f8-4d76-a055-1bd22f0678f2 from mountpoint /dev/vdb
Oct 30 11:06:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Attempting to detach device vdb from instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:06:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:06:22 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:06:22 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:06:22 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:06:22 user nova-compute[74278]:   <serial>5feb7441-95f8-4d76-a055-1bd22f0678f2</serial>
Oct 30 11:06:22 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 11:06:22 user nova-compute[74278]: </disk>
Oct 30 11:06:22 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:06:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully detached device vdb from instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 from the persistent domain config.
Oct 30 11:06:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:06:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:06:22 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:06:22 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:06:22 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:06:22 user nova-compute[74278]:   <serial>5feb7441-95f8-4d76-a055-1bd22f0678f2</serial>
Oct 30 11:06:22 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 11:06:22 user nova-compute[74278]: </disk>
Oct 30 11:06:22 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:06:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:06:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:27 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:29 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:29 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:06:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:30 user nova-compute[74278]: INFO nova.compute.manager [None req-fa995cad-16f1-4c81-9e65-d665073dd302 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Unrescuing
Oct 30 11:06:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fa995cad-16f1-4c81-9e65-d665073dd302 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "refresh_cache-6d868c1e-1985-48b6-a881-4d17b364701a" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fa995cad-16f1-4c81-9e65-d665073dd302 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquired lock "refresh_cache-6d868c1e-1985-48b6-a881-4d17b364701a" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG nova.network.neutron [None req-fa995cad-16f1-4c81-9e65-d665073dd302 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:06:30 user nova-compute[74278]: INFO nova.compute.manager [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Detaching volume 00a4d066-fc8a-4376-badd-5ed405442e93
Oct 30 11:06:30 user nova-compute[74278]: INFO nova.virt.block_device [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Attempting to driver detach volume 00a4d066-fc8a-4376-badd-5ed405442e93 from mountpoint /dev/vdc
Oct 30 11:06:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Attempting to detach device vdc from instance 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:06:30 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:06:30 user nova-compute[74278]:   <source dev="/dev/sde"/>
Oct 30 11:06:30 user nova-compute[74278]:   <target dev="vdc" bus="virtio"/>
Oct 30 11:06:30 user nova-compute[74278]:   <serial>00a4d066-fc8a-4376-badd-5ed405442e93</serial>
Oct 30 11:06:30 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 11:06:30 user nova-compute[74278]: </disk>
Oct 30 11:06:30 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:06:30 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Successfully detached device vdc from instance 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 from the persistent domain config.
Oct 30 11:06:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:06:30 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:06:30 user nova-compute[74278]:   <source dev="/dev/sde"/>
Oct 30 11:06:30 user nova-compute[74278]:   <target dev="vdc" bus="virtio"/>
Oct 30 11:06:30 user nova-compute[74278]:   <serial>00a4d066-fc8a-4376-badd-5ed405442e93</serial>
Oct 30 11:06:30 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 11:06:30 user nova-compute[74278]: </disk>
Oct 30 11:06:30 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG nova.network.neutron [None req-fa995cad-16f1-4c81-9e65-d665073dd302 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Updating instance_info_cache with network_info: [{"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fa995cad-16f1-4c81-9e65-d665073dd302 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Releasing lock "refresh_cache-6d868c1e-1985-48b6-a881-4d17b364701a" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG nova.objects.instance [None req-fa995cad-16f1-4c81-9e65-d665073dd302 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'flavor' on Instance uuid 6d868c1e-1985-48b6-a881-4d17b364701a {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Updating instance_info_cache with network_info: [{"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-2591f731-03b7-49b6-93af-c5b63e505127" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:06:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:31 user nova-compute[74278]: DEBUG nova.compute.manager [req-0b7a8006-7ff1-4986-8b7b-39b5499e117e req-eaeb5995-b7f2-4050-9b3b-e67cb2be12a3 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-unplugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:06:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0b7a8006-7ff1-4986-8b7b-39b5499e117e req-eaeb5995-b7f2-4050-9b3b-e67cb2be12a3 service nova] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0b7a8006-7ff1-4986-8b7b-39b5499e117e req-eaeb5995-b7f2-4050-9b3b-e67cb2be12a3 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0b7a8006-7ff1-4986-8b7b-39b5499e117e req-eaeb5995-b7f2-4050-9b3b-e67cb2be12a3 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:31 user nova-compute[74278]: DEBUG nova.compute.manager [req-0b7a8006-7ff1-4986-8b7b-39b5499e117e req-eaeb5995-b7f2-4050-9b3b-e67cb2be12a3 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] No waiting events found dispatching network-vif-unplugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:06:31 user nova-compute[74278]: WARNING nova.compute.manager [req-0b7a8006-7ff1-4986-8b7b-39b5499e117e req-eaeb5995-b7f2-4050-9b3b-e67cb2be12a3 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received unexpected event network-vif-unplugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b for instance with vm_state rescued and task_state unrescuing.
Oct 30 11:06:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:06:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:31 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:31 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Instance destroyed successfully.
Oct 30 11:06:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG nova.compute.manager [req-a1406583-4f0f-4a19-95a2-d1654ce27713 req-96711fd4-c879-4220-a019-eb1f92355a28 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a1406583-4f0f-4a19-95a2-d1654ce27713 req-96711fd4-c879-4220-a019-eb1f92355a28 service nova] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a1406583-4f0f-4a19-95a2-d1654ce27713 req-96711fd4-c879-4220-a019-eb1f92355a28 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a1406583-4f0f-4a19-95a2-d1654ce27713 req-96711fd4-c879-4220-a019-eb1f92355a28 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG nova.compute.manager [req-a1406583-4f0f-4a19-95a2-d1654ce27713 req-96711fd4-c879-4220-a019-eb1f92355a28 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] No waiting events found dispatching network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:06:33 user nova-compute[74278]: WARNING nova.compute.manager [req-a1406583-4f0f-4a19-95a2-d1654ce27713 req-96711fd4-c879-4220-a019-eb1f92355a28 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received unexpected event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b for instance with vm_state rescued and task_state unrescuing.
Oct 30 11:06:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:33 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:06:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-860c0174-5c7b-41db-9a90-60c7c6514d09 req-b1166616-a629-449e-b948-925271e2d926 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-860c0174-5c7b-41db-9a90-60c7c6514d09 req-b1166616-a629-449e-b948-925271e2d926 service nova] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-860c0174-5c7b-41db-9a90-60c7c6514d09 req-b1166616-a629-449e-b948-925271e2d926 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-860c0174-5c7b-41db-9a90-60c7c6514d09 req-b1166616-a629-449e-b948-925271e2d926 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-860c0174-5c7b-41db-9a90-60c7c6514d09 req-b1166616-a629-449e-b948-925271e2d926 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] No waiting events found dispatching network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:06:35 user nova-compute[74278]: WARNING nova.compute.manager [req-860c0174-5c7b-41db-9a90-60c7c6514d09 req-b1166616-a629-449e-b948-925271e2d926 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received unexpected event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b for instance with vm_state rescued and task_state unrescuing.
Oct 30 11:06:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-860c0174-5c7b-41db-9a90-60c7c6514d09 req-b1166616-a629-449e-b948-925271e2d926 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-860c0174-5c7b-41db-9a90-60c7c6514d09 req-b1166616-a629-449e-b948-925271e2d926 service nova] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-860c0174-5c7b-41db-9a90-60c7c6514d09 req-b1166616-a629-449e-b948-925271e2d926 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-860c0174-5c7b-41db-9a90-60c7c6514d09 req-b1166616-a629-449e-b948-925271e2d926 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-860c0174-5c7b-41db-9a90-60c7c6514d09 req-b1166616-a629-449e-b948-925271e2d926 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] No waiting events found dispatching network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:06:35 user nova-compute[74278]: WARNING nova.compute.manager [req-860c0174-5c7b-41db-9a90-60c7c6514d09 req-b1166616-a629-449e-b948-925271e2d926 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received unexpected event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b for instance with vm_state rescued and task_state unrescuing.
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG nova.compute.manager [None req-fa995cad-16f1-4c81-9e65-d665073dd302 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:06:37 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:06:37 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:06:37 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7538MB free_disk=24.780826568603516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:06:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 64287717-7d3b-4087-aedf-faf87be774a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 6d868c1e-1985-48b6-a881-4d17b364701a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance f35f1e59-504e-42d2-9d50-f14a32844bdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance c5293f0b-eeaf-4180-9968-05e37211c6bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a5826048-2aeb-49ed-ac49-7d2327d70e92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing inventories for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating ProviderTree inventory for provider ce405684-67ab-45d9-bc83-6af4903bfb15 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating inventory in ProviderTree for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing aggregate associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, aggregates: None {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing trait associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.037s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74278) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 11:06:38 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIHyoPVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:06:39 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:06:39 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:06:39 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d3406e-e83f-4c33-94b2-ef61f8f86539]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:06:39 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f76a75e-280a-44b1-a7fe-d6e0cbf4fd81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0] added
Oct 30 11:06:39 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e509de-8395-474f-a846-1091d9ef7e5c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc8bfb9-86ec-4e95-936f-c2d3c6f73a9d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIHyoPVb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIHyoPVb" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e677c2-52da-4a09-9a75-ac9d899b04ac]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vIHyoPVb'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a14c100-33e3-4d69-aec9-ab394afcca80]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6925992-a817-4352-b4ee-1d55ebf86019]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3f678d-6f56-497d-87ad-4c6a45093bb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0, portal: 172.16.0.220,3260]
Oct 30 11:06:39 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0, portal: 172.16.0.220,3260] successful.
Oct 30 11:06:39 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6309e4-ad8b-48af-8f1c-26ec589cbb13]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9ac636-5f3e-4cfd-9cf3-e0c4409d77da]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] There are 0 instances to clean {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:06:39 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dc8cc2-2269-46a0-82fe-0f058d7adcde]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:06:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIHyoPVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:06:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:06:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23536336162386566', 'path': '/dev/sdd'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:06:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536336162386566', 'path': '/dev/sdd'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:06:40 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lazy-loading 'flavor' on Instance uuid f35f1e59-504e-42d2-9d50-f14a32844bdb {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:06:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:06:40 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:06:40 user nova-compute[74278]:   <source dev="/dev/sdd"/>
Oct 30 11:06:40 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:06:40 user nova-compute[74278]:   <serial>1487bc7d-c642-4d94-b6ca-265826cb91b0</serial>
Oct 30 11:06:40 user nova-compute[74278]: </disk>
Oct 30 11:06:40 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:06:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:06:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:06:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] No VIF found with MAC fa:16:3e:6f:fb:3d, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:06:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e928083d-10a6-4c53-863c-b3bf5cc914d5 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.368s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:43 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 is timed out.
Oct 30 11:06:43 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully detached device vdb from instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9 from the live domain config.
Oct 30 11:06:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoweczUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:06:43 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b10e046-b28e-4b1d-8d86-917acba89427]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:06:43 user nova-compute[74278]: No targets found.
Oct 30 11:06:43 user nova-compute[74278]: iSNS:
Oct 30 11:06:43 user nova-compute[74278]: No targets found.
Oct 30 11:06:43 user nova-compute[74278]: STATIC:
Oct 30 11:06:43 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2
Oct 30 11:06:43 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:06:43 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:06:43 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3
Oct 30 11:06:43 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:06:43 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:06:43 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0
Oct 30 11:06:43 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:06:43 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:06:43 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:06:43 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:06:43 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:06:43 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93
Oct 30 11:06:43 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:06:43 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:06:43 user nova-compute[74278]: FIRMWARE:
Oct 30 11:06:43 user nova-compute[74278]: No targets found.
Oct 30 11:06:43 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:06:43 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:06:43 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a043828-071b-43b8-8315-c9098527f344]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a891d223-a325-46c3-8c12-b6bc9a6dd41a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:06:43 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:06:43 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:06:43 user nova-compute[74278]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)
Oct 30 11:06:43 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:06:43 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:06:43 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:06:43 user nova-compute[74278]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 (non-flash)
Oct 30 11:06:43 user nova-compute[74278]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)
Oct 30 11:06:43 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:06:43 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c30dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eb861a-2f73-49e9-abeb-f89fb3935a8d]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b54d4b7-a0d1-4ba0-9710-561266d8d75f]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b547a53f-d616-4f30-bc11-bec7347b9c06]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7ed06f-f922-4afa-a57b-80633a5c54a4]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d57430a-cbd8-4bbb-a9bd-bd971f611ddb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f81d4c-2abb-41b4-bf16-c121ce5ad099]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260]
Oct 30 11:06:43 user nova-compute[74278]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2, portal: 172.16.0.220,3260] successful.
Oct 30 11:06:43 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5feb7441-95f8-4d76-a055-1bd22f0678f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64bebc4-3fda-4807-b9bf-2d18a3d5ebec]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== disconnect_volume: return (367ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:06:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:06:44 user nova-compute[74278]: DEBUG nova.objects.instance [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lazy-loading 'flavor' on Instance uuid e94c4f7c-6e99-4694-84d6-ed62c385a4f9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:06:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18c60b28-ed67-46db-ba14-9a7417c628b1 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.187s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lazy-loading 'flavor' on Instance uuid f35f1e59-504e-42d2-9d50-f14a32844bdb {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:45 user nova-compute[74278]: INFO nova.compute.manager [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Attaching volume 28431c9f-a7cb-44ac-87ea-50ec8f868223 to /dev/vdc
Oct 30 11:06:45 user nova-compute[74278]: DEBUG os_brick.utils [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7cdfb8-3a0b-4f5d-8da1-808f51f2c43e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10c371a-0844-42c4-9626-728b92fb0ad5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa21376-84d5-4b30-a651-8c40157611c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc4e9f2-8ed7-459c-8822-a352fe78a0fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:06:45 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:06:45 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[21af9550-4f5f-40f0-88c1-42065cbc6ce3]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG os_brick.utils [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:06:45 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Updating existing volume attachment record: 0c2631d0-963a-448a-92b9-9051a828ea83 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid da67673a-dbe6-419f-8547-5ca730f14003 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 2591f731-03b7-49b6-93af-c5b63e505127 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 65466a3f-2824-4172-a3c2-8fba650788e9 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 64287717-7d3b-4087-aedf-faf87be774a8 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid e94c4f7c-6e99-4694-84d6-ed62c385a4f9 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 6d868c1e-1985-48b6-a881-4d17b364701a {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid f35f1e59-504e-42d2-9d50-f14a32844bdb {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid c5293f0b-eeaf-4180-9968-05e37211c6bd {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid a5826048-2aeb-49ed-ac49-7d2327d70e92 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "da67673a-dbe6-419f-8547-5ca730f14003" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "da67673a-dbe6-419f-8547-5ca730f14003" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "2591f731-03b7-49b6-93af-c5b63e505127" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "65466a3f-2824-4172-a3c2-8fba650788e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "65466a3f-2824-4172-a3c2-8fba650788e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "64287717-7d3b-4087-aedf-faf87be774a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "64287717-7d3b-4087-aedf-faf87be774a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "6d868c1e-1985-48b6-a881-4d17b364701a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.006s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "a5826048-2aeb-49ed-ac49-7d2327d70e92" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "da67673a-dbe6-419f-8547-5ca730f14003" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "2591f731-03b7-49b6-93af-c5b63e505127" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "65466a3f-2824-4172-a3c2-8fba650788e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "64287717-7d3b-4087-aedf-faf87be774a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "6d868c1e-1985-48b6-a881-4d17b364701a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:51 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 is timed out.
Oct 30 11:06:51 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Successfully detached device vdc from instance 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 from the live domain config.
Oct 30 11:06:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQuAaEqh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:06:51 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc67296-9abe-436a-b663-269e04032706]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:06:51 user nova-compute[74278]: No targets found.
Oct 30 11:06:51 user nova-compute[74278]: iSNS:
Oct 30 11:06:51 user nova-compute[74278]: No targets found.
Oct 30 11:06:51 user nova-compute[74278]: STATIC:
Oct 30 11:06:51 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3
Oct 30 11:06:51 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:06:51 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:06:51 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0
Oct 30 11:06:51 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:06:51 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:06:51 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:06:51 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:06:51 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:06:51 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93
Oct 30 11:06:51 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:06:51 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:06:51 user nova-compute[74278]: FIRMWARE:
Oct 30 11:06:51 user nova-compute[74278]: No targets found.
Oct 30 11:06:51 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:06:51 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:06:51 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0381743-f7d8-47be-b6e7-6cd1daa9f026]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[53423f6b-1831-4ae0-912d-6c5604cfbb29]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:06:51 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:06:51 user nova-compute[74278]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)
Oct 30 11:06:51 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:06:51 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:06:51 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:06:51 user nova-compute[74278]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 (non-flash)
Oct 30 11:06:51 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:06:51 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac493490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93'): ({'sde'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Removing single pathed devices sde {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad367fd9-e9aa-46ce-9cfa-fc71fab82fd4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[55684435-9bd4-4967-994b-ffc98ccc6481]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Flushing IO for device /dev/sde {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9161592-e071-4bba-b9a3-c4f32af15736]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a591b6f6-b085-4c40-9d8a-97797f6c3795]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] SCSI volumes sde have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d5658a-613e-4183-af87-088734513785]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3c7bc5-39ee-4c0e-a281-5d026ecfb9f8]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93, portal: 172.16.0.220,3260]
Oct 30 11:06:51 user nova-compute[74278]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93, portal: 172.16.0.220,3260] successful.
Oct 30 11:06:51 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a4d066-fc8a-4376-badd-5ed405442e93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[af06628f-fdfd-494b-b82e-ff1dd3fb5d73]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] <== disconnect_volume: return (368ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:06:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:06:52 user nova-compute[74278]: DEBUG nova.objects.instance [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'flavor' on Instance uuid 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:06:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-96352b20-5625-4198-a6bb-e2a548eaa46c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.051s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.205s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:06:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:06:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:06:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMHguCri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:07:07 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:07:07 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:07:07 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[098edd2c-7faf-40a5-afaf-d6f339fc236e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:07:07 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c00840e-9ed7-4e2b-b2f4-00a007f2903f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223] added
Oct 30 11:07:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0dc4f7-a4b4-41f0-b89c-3447ac021aaa]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.162s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[55409f1e-d05b-4811-9670-ce8bf35585d5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KMHguCri {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KMHguCri" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f54d93-7d61-42bc-895b-9d622d12a5d4]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KMHguCri'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[398b74bc-bec7-4710-9018-c6a0b3a72541]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fc0e64-0738-4974-a749-4577ea9c7c41]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b51c0d-f76f-47a6-8b21-7971fd284da3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223, portal: 172.16.0.220,3260]
Oct 30 11:07:07 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223, portal: 172.16.0.220,3260] successful.
Oct 30 11:07:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[09231329-902a-4d72-b83a-85d757168473]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[db40a39f-55a6-453a-a55f-8b4f3f594f74]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 (non-flash)
Oct 30 11:07:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.487s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73bb4ad-5c83-4016-b6ef-fe566dd290bb]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:07:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-152a76a4-4dfe-4e45-9f96-7b01de1547a0 req-bcaff6f8-9a9e-4ca6-8798-2b9880c85fd6 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Received event network-changed-9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-152a76a4-4dfe-4e45-9f96-7b01de1547a0 req-bcaff6f8-9a9e-4ca6-8798-2b9880c85fd6 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Refreshing instance network info cache due to event network-changed-9ccd5489-aa26-43ed-a1a5-e1984cb4300a. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:07:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-152a76a4-4dfe-4e45-9f96-7b01de1547a0 req-bcaff6f8-9a9e-4ca6-8798-2b9880c85fd6 service nova] Acquiring lock "refresh_cache-c5293f0b-eeaf-4180-9968-05e37211c6bd" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:07:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-152a76a4-4dfe-4e45-9f96-7b01de1547a0 req-bcaff6f8-9a9e-4ca6-8798-2b9880c85fd6 service nova] Acquired lock "refresh_cache-c5293f0b-eeaf-4180-9968-05e37211c6bd" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:07:08 user nova-compute[74278]: DEBUG nova.network.neutron [req-152a76a4-4dfe-4e45-9f96-7b01de1547a0 req-bcaff6f8-9a9e-4ca6-8798-2b9880c85fd6 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Refreshing network info cache for port 9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:07:08 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:07:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMHguCri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:07:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.522s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:07:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] <== connect_volume: return (1523ms) {'type': 'block', 'scsi_wwn': '23161393334643539', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:07:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161393334643539', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:07:08 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lazy-loading 'flavor' on Instance uuid f35f1e59-504e-42d2-9d50-f14a32844bdb {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:07:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:07:08 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:07:08 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:07:08 user nova-compute[74278]:   <target dev="vdc" bus="virtio"/>
Oct 30 11:07:08 user nova-compute[74278]:   <serial>28431c9f-a7cb-44ac-87ea-50ec8f868223</serial>
Oct 30 11:07:08 user nova-compute[74278]: </disk>
Oct 30 11:07:08 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:07:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:07:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:07:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:07:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] No VIF found with MAC fa:16:3e:6f:fb:3d, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:07:09 user nova-compute[74278]: DEBUG nova.network.neutron [req-152a76a4-4dfe-4e45-9f96-7b01de1547a0 req-bcaff6f8-9a9e-4ca6-8798-2b9880c85fd6 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Updated VIF entry in instance network info cache for port 9ccd5489-aa26-43ed-a1a5-e1984cb4300a. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:07:09 user nova-compute[74278]: DEBUG nova.network.neutron [req-152a76a4-4dfe-4e45-9f96-7b01de1547a0 req-bcaff6f8-9a9e-4ca6-8798-2b9880c85fd6 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Updating instance_info_cache with network_info: [{"id": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "address": "fa:16:3e:1d:00:99", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ccd5489-aa", "ovs_interfaceid": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:07:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eb7300bd-9c8b-4b15-a727-51bb6bde26fa tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.131s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 22.580s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-152a76a4-4dfe-4e45-9f96-7b01de1547a0 req-bcaff6f8-9a9e-4ca6-8798-2b9880c85fd6 service nova] Releasing lock "refresh_cache-c5293f0b-eeaf-4180-9968-05e37211c6bd" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:07:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:10 user nova-compute[74278]: INFO nova.compute.manager [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Detaching volume 28431c9f-a7cb-44ac-87ea-50ec8f868223
Oct 30 11:07:11 user nova-compute[74278]: INFO nova.virt.block_device [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Attempting to driver detach volume 28431c9f-a7cb-44ac-87ea-50ec8f868223 from mountpoint /dev/vdc
Oct 30 11:07:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Attempting to detach device vdc from instance f35f1e59-504e-42d2-9d50-f14a32844bdb from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:07:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:07:11 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:07:11 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:07:11 user nova-compute[74278]:   <target dev="vdc" bus="virtio"/>
Oct 30 11:07:11 user nova-compute[74278]:   <serial>28431c9f-a7cb-44ac-87ea-50ec8f868223</serial>
Oct 30 11:07:11 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 11:07:11 user nova-compute[74278]: </disk>
Oct 30 11:07:11 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:07:11 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Successfully detached device vdc from instance f35f1e59-504e-42d2-9d50-f14a32844bdb from the persistent domain config.
Oct 30 11:07:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f35f1e59-504e-42d2-9d50-f14a32844bdb from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:07:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:07:11 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:07:11 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:07:11 user nova-compute[74278]:   <target dev="vdc" bus="virtio"/>
Oct 30 11:07:11 user nova-compute[74278]:   <serial>28431c9f-a7cb-44ac-87ea-50ec8f868223</serial>
Oct 30 11:07:11 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 11:07:11 user nova-compute[74278]: </disk>
Oct 30 11:07:11 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:07:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f35f1e59-504e-42d2-9d50-f14a32844bdb {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:13 user nova-compute[74278]: INFO nova.compute.manager [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Terminating instance
Oct 30 11:07:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-4e97222d-1206-4196-9f65-c65542f5ef2a req-d92d3591-7370-4f99-9c93-d64baabd6571 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-unplugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4e97222d-1206-4196-9f65-c65542f5ef2a req-d92d3591-7370-4f99-9c93-d64baabd6571 service nova] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4e97222d-1206-4196-9f65-c65542f5ef2a req-d92d3591-7370-4f99-9c93-d64baabd6571 service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4e97222d-1206-4196-9f65-c65542f5ef2a req-d92d3591-7370-4f99-9c93-d64baabd6571 service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-4e97222d-1206-4196-9f65-c65542f5ef2a req-d92d3591-7370-4f99-9c93-d64baabd6571 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] No waiting events found dispatching network-vif-unplugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-4e97222d-1206-4196-9f65-c65542f5ef2a req-d92d3591-7370-4f99-9c93-d64baabd6571 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-unplugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:14 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Instance destroyed successfully.
Oct 30 11:07:14 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lazy-loading 'resources' on Instance uuid e94c4f7c-6e99-4694-84d6-ed62c385a4f9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:01:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-271667642',display_name='tempest-ServerActionsTestOtherA-server-2045755829',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-271667642',id=27,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD4PHb/9XzyvWLBbPO6wny4wEPuXFI3gaSrqSdwmjCZkbsuAHJH7SKFqW6FChsnRgIXFl9df68Jt5kVrUhD4iFw8HDLHHScd2I9aHIHob65iYrnC7ObhbXR1SqG3E6kOA==',key_name='tempest-keypair-433171770',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:04:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-5otvhosk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:04:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=e94c4f7c-6e99-4694-84d6-ed62c385a4f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "address": "fa:16:3e:f9:3c:94", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0cd08c8-6f", "ovs_interfaceid": "d0cd08c8-6f28-46d3-a6ad-c2b65ef16803", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG os_vif [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0cd08c8-6f, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2cb3fb7-0bba-406d-a195-19dc164ffe5c) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:14 user nova-compute[74278]: INFO os_vif [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:3c:94,bridge_name='br-int',has_traffic_filtering=True,id=d0cd08c8-6f28-46d3-a6ad-c2b65ef16803,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0cd08c8-6f')
Oct 30 11:07:14 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Deleting instance files /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9_del
Oct 30 11:07:14 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Deletion of /opt/stack/data/nova/instances/e94c4f7c-6e99-4694-84d6-ed62c385a4f9_del complete
Oct 30 11:07:14 user nova-compute[74278]: INFO nova.compute.manager [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 30 11:07:14 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:07:15 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Took 1.26 seconds to deallocate network for instance.
Oct 30 11:07:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-0cf1aecf-d61e-4f7f-98f2-d2905bb87d42 req-416d9d2b-fe15-4a86-843c-cf08d76aeed1 service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-deleted-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] No waiting events found dispatching network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:07:15 user nova-compute[74278]: WARNING nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received unexpected event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 for instance with vm_state deleted and task_state None.
Oct 30 11:07:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] No waiting events found dispatching network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:07:15 user nova-compute[74278]: WARNING nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received unexpected event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 for instance with vm_state deleted and task_state None.
Oct 30 11:07:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] No waiting events found dispatching network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:07:15 user nova-compute[74278]: WARNING nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received unexpected event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 for instance with vm_state deleted and task_state None.
Oct 30 11:07:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-unplugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] No waiting events found dispatching network-vif-unplugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:07:15 user nova-compute[74278]: WARNING nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received unexpected event network-vif-unplugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 for instance with vm_state deleted and task_state None.
Oct 30 11:07:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Acquiring lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] No waiting events found dispatching network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:07:15 user nova-compute[74278]: WARNING nova.compute.manager [req-b0324b7d-c37b-4064-94bc-f346b1e1ae70 req-03338959-a81c-48f7-b67a-a913c8473d1c service nova] [instance: e94c4f7c-6e99-4694-84d6-ed62c385a4f9] Received unexpected event network-vif-plugged-d0cd08c8-6f28-46d3-a6ad-c2b65ef16803 for instance with vm_state deleted and task_state None.
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG nova.objects.instance [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid c5293f0b-eeaf-4180-9968-05e37211c6bd {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:16 user nova-compute[74278]: INFO nova.compute.manager [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Attaching volume 5f581754-1df5-486f-9cc3-ca226c023fa9 to /dev/vdb
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:16 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Deleted allocations for instance e94c4f7c-6e99-4694-84d6-ed62c385a4f9
Oct 30 11:07:16 user nova-compute[74278]: DEBUG os_brick.utils [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffc321e-1ce5-42e2-819f-ac7da27a2315]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caabcbb-c885-40bd-b7d4-61b27e5efe4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9670b366-553b-4d50-8917-d1c6a7491d96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[072b4a8c-a539-4ea0-b3dd-d929995c9b70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:07:16 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4881d188-c81a-483b-b905-6e1eab5c11a4]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG os_brick.utils [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Updating existing volume attachment record: 12f0cce2-a6dd-4ee2-9d6e-2d3e71f8dea8 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:07:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8073a562-c8f0-4d89-aaef-ee1e63702129 tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "e94c4f7c-6e99-4694-84d6-ed62c385a4f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.478s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:20 user nova-compute[74278]: INFO nova.compute.manager [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Terminating instance
Oct 30 11:07:20 user nova-compute[74278]: DEBUG nova.compute.manager [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-333362d1-c52c-4973-b82c-eea27c970186 req-3a8d5142-6f48-4cd5-9dbd-877d9ede1b99 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-vif-unplugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-333362d1-c52c-4973-b82c-eea27c970186 req-3a8d5142-6f48-4cd5-9dbd-877d9ede1b99 service nova] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-333362d1-c52c-4973-b82c-eea27c970186 req-3a8d5142-6f48-4cd5-9dbd-877d9ede1b99 service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-333362d1-c52c-4973-b82c-eea27c970186 req-3a8d5142-6f48-4cd5-9dbd-877d9ede1b99 service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-333362d1-c52c-4973-b82c-eea27c970186 req-3a8d5142-6f48-4cd5-9dbd-877d9ede1b99 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] No waiting events found dispatching network-vif-unplugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-333362d1-c52c-4973-b82c-eea27c970186 req-3a8d5142-6f48-4cd5-9dbd-877d9ede1b99 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-vif-unplugged-0ca50716-192b-473f-bc5a-d1136a8d52dd for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:21 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Instance destroyed successfully.
Oct 30 11:07:21 user nova-compute[74278]: DEBUG nova.objects.instance [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'resources' on Instance uuid 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:00:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1355088922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1355088922',id=25,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfQ76Zf86y/rjX/IZezKroDYRlFxXL4tU5bjyfpE8hTO7Xt3y63g6U10DcW7GCutVK3ORDNhBNel2yoFanFAo9wPHbUl8cHjyHqp+8+3mQyx7QRSBig2itKO+0OYjDbew==',key_name='tempest-keypair-344221549',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:05:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31dd01e2d9be4a0b96e94493f8eb43d7',ramdisk_id='',reservation_id='r-y1dpjo0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2142703659',owner_user_name='tempest-AttachVolumeShelveTestJSON-2142703659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:05:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584de218cec24240a91845deca515efa',uuid=5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converting VIF {"id": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "address": "fa:16:3e:12:c3:5f", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ca50716-19", "ovs_interfaceid": "0ca50716-192b-473f-bc5a-d1136a8d52dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG os_vif [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ca50716-19, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e53106af-bea7-4db4-b910-b482227c911e) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:21 user nova-compute[74278]: INFO os_vif [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:c3:5f,bridge_name='br-int',has_traffic_filtering=True,id=0ca50716-192b-473f-bc5a-d1136a8d52dd,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ca50716-19')
Oct 30 11:07:21 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Deleting instance files /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3_del
Oct 30 11:07:21 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Deletion of /opt/stack/data/nova/instances/5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3_del complete
Oct 30 11:07:21 user nova-compute[74278]: INFO nova.compute.manager [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 30 11:07:21 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:07:21 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:07:22 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:07:22 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Took 0.95 seconds to deallocate network for instance.
Oct 30 11:07:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-85630757-9144-4d56-876b-0c42cf0867ac req-7bf7da1b-ddff-4e71-9bd1-d3fc4c785fc5 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-vif-deleted-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:23 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:07:23 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:07:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:23 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Deleted allocations for instance 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3
Oct 30 11:07:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-4809c3bd-a4c6-4071-b025-41e4e47a9181 req-52e91161-be76-425a-b8a2-bbe19829f941 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received event network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4809c3bd-a4c6-4071-b025-41e4e47a9181 req-52e91161-be76-425a-b8a2-bbe19829f941 service nova] Acquiring lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4809c3bd-a4c6-4071-b025-41e4e47a9181 req-52e91161-be76-425a-b8a2-bbe19829f941 service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4809c3bd-a4c6-4071-b025-41e4e47a9181 req-52e91161-be76-425a-b8a2-bbe19829f941 service nova] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-4809c3bd-a4c6-4071-b025-41e4e47a9181 req-52e91161-be76-425a-b8a2-bbe19829f941 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] No waiting events found dispatching network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:07:23 user nova-compute[74278]: WARNING nova.compute.manager [req-4809c3bd-a4c6-4071-b025-41e4e47a9181 req-52e91161-be76-425a-b8a2-bbe19829f941 service nova] [instance: 5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3] Received unexpected event network-vif-plugged-0ca50716-192b-473f-bc5a-d1136a8d52dd for instance with vm_state deleted and task_state None.
Oct 30 11:07:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-49101ae9-b78d-48ad-a083-f32665b56e5c tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "5e8610dc-8da3-4ce6-ab23-fe3c87fb1dc3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.647s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "a5826048-2aeb-49ed-ac49-7d2327d70e92" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:28 user nova-compute[74278]: INFO nova.compute.manager [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Terminating instance
Oct 30 11:07:28 user nova-compute[74278]: DEBUG nova.compute.manager [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:28 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Instance destroyed successfully.
Oct 30 11:07:28 user nova-compute[74278]: DEBUG nova.objects.instance [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lazy-loading 'resources' on Instance uuid a5826048-2aeb-49ed-ac49-7d2327d70e92 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:05:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1740467051',display_name='tempest-VolumesActionsTest-instance-1740467051',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1740467051',id=34,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:05:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6516f9ae7cc1453db5bea067d108eed1',ramdisk_id='',reservation_id='r-8s3rcw3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1938085894',owner_user_name='tempest-VolumesActionsTest-1938085894-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:05:43Z,user_data=None,user_id='2a8ce768d96b4d42ae87c9e3af6c4592',uuid=a5826048-2aeb-49ed-ac49-7d2327d70e92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "address": "fa:16:3e:61:ae:96", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0fbbe9-e7", "ovs_interfaceid": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Converting VIF {"id": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "address": "fa:16:3e:61:ae:96", "network": {"id": "25bc7d94-c9f8-406c-8575-68aff91ae435", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1233333896-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6516f9ae7cc1453db5bea067d108eed1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0fbbe9-e7", "ovs_interfaceid": "6d0fbbe9-e748-418c-b2ad-41fd7e4a4048", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=6d0fbbe9-e748-418c-b2ad-41fd7e4a4048,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0fbbe9-e7') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG os_vif [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=6d0fbbe9-e748-418c-b2ad-41fd7e4a4048,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0fbbe9-e7') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-7344f721-27f1-4d0b-a9b1-d71fc2d318cd req-a5752dd8-f307-43e3-8de9-af320dc71626 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Received event network-vif-unplugged-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7344f721-27f1-4d0b-a9b1-d71fc2d318cd req-a5752dd8-f307-43e3-8de9-af320dc71626 service nova] Acquiring lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7344f721-27f1-4d0b-a9b1-d71fc2d318cd req-a5752dd8-f307-43e3-8de9-af320dc71626 service nova] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7344f721-27f1-4d0b-a9b1-d71fc2d318cd req-a5752dd8-f307-43e3-8de9-af320dc71626 service nova] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-7344f721-27f1-4d0b-a9b1-d71fc2d318cd req-a5752dd8-f307-43e3-8de9-af320dc71626 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] No waiting events found dispatching network-vif-unplugged-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-7344f721-27f1-4d0b-a9b1-d71fc2d318cd req-a5752dd8-f307-43e3-8de9-af320dc71626 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Received event network-vif-unplugged-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d0fbbe9-e7, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=940e1e5a-3cf8-4f16-9f7c-dc069c40ba9b) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:07:28 user nova-compute[74278]: INFO os_vif [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ae:96,bridge_name='br-int',has_traffic_filtering=True,id=6d0fbbe9-e748-418c-b2ad-41fd7e4a4048,network=Network(25bc7d94-c9f8-406c-8575-68aff91ae435),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0fbbe9-e7')
Oct 30 11:07:28 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Deleting instance files /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92_del
Oct 30 11:07:28 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Deletion of /opt/stack/data/nova/instances/a5826048-2aeb-49ed-ac49-7d2327d70e92_del complete
Oct 30 11:07:28 user nova-compute[74278]: INFO nova.compute.manager [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Took 0.78 seconds to destroy the instance on the hypervisor.
Oct 30 11:07:28 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:07:28 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:07:29 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:07:29 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Took 0.52 seconds to deallocate network for instance.
Oct 30 11:07:29 user nova-compute[74278]: DEBUG nova.compute.manager [req-015d461c-4915-4853-9d04-ec1e2b5a238e req-0020f3a3-ce84-4c96-a1da-610f9b3d5068 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Received event network-vif-deleted-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:29 user nova-compute[74278]: INFO nova.compute.manager [req-015d461c-4915-4853-9d04-ec1e2b5a238e req-0020f3a3-ce84-4c96-a1da-610f9b3d5068 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Neutron deleted interface 6d0fbbe9-e748-418c-b2ad-41fd7e4a4048; detaching it from the instance and deleting it from the info cache
Oct 30 11:07:29 user nova-compute[74278]: DEBUG nova.network.neutron [req-015d461c-4915-4853-9d04-ec1e2b5a238e req-0020f3a3-ce84-4c96-a1da-610f9b3d5068 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:07:29 user nova-compute[74278]: DEBUG nova.compute.manager [req-015d461c-4915-4853-9d04-ec1e2b5a238e req-0020f3a3-ce84-4c96-a1da-610f9b3d5068 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Detach interface failed, port_id=6d0fbbe9-e748-418c-b2ad-41fd7e4a4048, reason: Instance a5826048-2aeb-49ed-ac49-7d2327d70e92 could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:07:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:29 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:07:29 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:07:29 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:07:29 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:07:29 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:07:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:29 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Deleted allocations for instance a5826048-2aeb-49ed-ac49-7d2327d70e92
Oct 30 11:07:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6598ed68-dd54-47f8-915c-d1e4be6baaba tempest-VolumesActionsTest-1938085894 tempest-VolumesActionsTest-1938085894-project-member] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.021s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-d2ffdcc0-db3e-4766-9cce-1b8b980d8d0b req-30040037-ce63-46af-82b2-1de9b8f1f432 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Received event network-vif-plugged-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:07:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d2ffdcc0-db3e-4766-9cce-1b8b980d8d0b req-30040037-ce63-46af-82b2-1de9b8f1f432 service nova] Acquiring lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d2ffdcc0-db3e-4766-9cce-1b8b980d8d0b req-30040037-ce63-46af-82b2-1de9b8f1f432 service nova] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d2ffdcc0-db3e-4766-9cce-1b8b980d8d0b req-30040037-ce63-46af-82b2-1de9b8f1f432 service nova] Lock "a5826048-2aeb-49ed-ac49-7d2327d70e92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-d2ffdcc0-db3e-4766-9cce-1b8b980d8d0b req-30040037-ce63-46af-82b2-1de9b8f1f432 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] No waiting events found dispatching network-vif-plugged-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:07:30 user nova-compute[74278]: WARNING nova.compute.manager [req-d2ffdcc0-db3e-4766-9cce-1b8b980d8d0b req-30040037-ce63-46af-82b2-1de9b8f1f432 service nova] [instance: a5826048-2aeb-49ed-ac49-7d2327d70e92] Received unexpected event network-vif-plugged-6d0fbbe9-e748-418c-b2ad-41fd7e4a4048 for instance with vm_state deleted and task_state None.
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:07:31 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f35f1e59-504e-42d2-9d50-f14a32844bdb is timed out.
Oct 30 11:07:31 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Successfully detached device vdc from instance f35f1e59-504e-42d2-9d50-f14a32844bdb from the live domain config.
Oct 30 11:07:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMHguCri', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:07:31 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e18c7a4-e5eb-4d2f-935d-ac04f858a71c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:07:31 user nova-compute[74278]: No targets found.
Oct 30 11:07:31 user nova-compute[74278]: iSNS:
Oct 30 11:07:31 user nova-compute[74278]: No targets found.
Oct 30 11:07:31 user nova-compute[74278]: STATIC:
Oct 30 11:07:31 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3
Oct 30 11:07:31 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:07:31 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:07:31 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0
Oct 30 11:07:31 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:07:31 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:07:31 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:07:31 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:07:31 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:07:31 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223
Oct 30 11:07:31 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:07:31 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:07:31 user nova-compute[74278]: FIRMWARE:
Oct 30 11:07:31 user nova-compute[74278]: No targets found.
Oct 30 11:07:31 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:07:31 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:07:31 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73df822-db4d-48dd-be9b-34a6b8251752]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8000155-ecaa-4c6f-8702-f60a89357769]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:07:31 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:07:31 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:07:31 user nova-compute[74278]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 (non-flash)
Oct 30 11:07:31 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:07:31 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:07:31 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:07:31 user nova-compute[74278]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 (non-flash)
Oct 30 11:07:31 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c31dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8154ddd8-9eae-41dc-9d50-5ca6f985ff61]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[248443e2-668b-4de7-af64-8681845acd9d]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb7c4b8-09f7-4daa-b82e-51af7fd3cc9f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[50008089-3c50-4638-b3a1-5dd62fbb875e]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da899eb-53b5-48f9-bc38-7b611c77fccb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[55805936-6328-45a1-aa54-04029ac359e9]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223, portal: 172.16.0.220,3260]
Oct 30 11:07:31 user nova-compute[74278]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223, portal: 172.16.0.220,3260] successful.
Oct 30 11:07:31 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28431c9f-a7cb-44ac-87ea-50ec8f868223 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e389067e-5f6c-4e00-b7f0-c1922f97dac2]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] <== disconnect_volume: return (315ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:07:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:07:32 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:07:32 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:07:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:07:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:07:32 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:07:32 user nova-compute[74278]: DEBUG nova.objects.instance [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lazy-loading 'flavor' on Instance uuid f35f1e59-504e-42d2-9d50-f14a32844bdb {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:07:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c89e28ab-8baa-4f52-987f-00ecd830722f tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.986s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:32 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updating instance_info_cache with network_info: [{"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:07:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:07:33 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:07:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:07:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:34 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:07:35 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:07:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:35 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:07:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:07:35 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:07:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:07:38 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:07:38 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7925MB free_disk=24.850982666015625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 64287717-7d3b-4087-aedf-faf87be774a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 6d868c1e-1985-48b6-a881-4d17b364701a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance f35f1e59-504e-42d2-9d50-f14a32844bdb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance c5293f0b-eeaf-4180-9968-05e37211c6bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwEQTGxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:07:39 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:07:39 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:07:39 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d5ad83-8892-47bf-9586-8c217b7436de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:07:39 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7350300-554f-4321-8946-288f1c7634aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9] added
Oct 30 11:07:39 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c687fb-0197-4b73-affd-fb38d3416f08]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e877efd-3c05-4f18-bc6e-c1068c674930]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SwEQTGxm {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SwEQTGxm" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c27eec-eeb3-4cf3-9574-b1ae7e050faf]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SwEQTGxm'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dafd5cb-c627-441e-9514-f76c46720367]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bddffd-dd28-40be-b6dd-d90612bc9503]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa0908b-adc3-4524-9ddc-7c983cf93318]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9, portal: 172.16.0.220,3260]
Oct 30 11:07:39 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9, portal: 172.16.0.220,3260] successful.
Oct 30 11:07:39 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a68eea-236c-4209-8f4f-3d3a4c78153c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95e546b-fa8d-4ea9-816d-8ad4b4a2e6ad]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)
Oct 30 11:07:39 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c6c7ce-d3ad-46fb-8e00-0af6d53dc873]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:07:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:40 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:07:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwEQTGxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:07:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:07:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26565333364336362', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:07:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565333364336362', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:07:40 user nova-compute[74278]: DEBUG nova.objects.instance [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid c5293f0b-eeaf-4180-9968-05e37211c6bd {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:07:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:07:40 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:07:40 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:07:40 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:07:40 user nova-compute[74278]:   <serial>5f581754-1df5-486f-9cc3-ca226c023fa9</serial>
Oct 30 11:07:40 user nova-compute[74278]: </disk>
Oct 30 11:07:40 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:07:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:07:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:07:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No VIF found with MAC fa:16:3e:1d:00:99, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:07:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-75579ee2-d2c5-4d50-94c7-e06189166788 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.022s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:43 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:07:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid c5293f0b-eeaf-4180-9968-05e37211c6bd {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:07:49 user nova-compute[74278]: INFO nova.compute.manager [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Attaching volume 99f23d90-26af-48fc-ab82-ac34191c5228 to /dev/vdc
Oct 30 11:07:49 user nova-compute[74278]: DEBUG os_brick.utils [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ae3459-4b17-419a-b0df-1689003cade6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc78c73-92dc-4533-8e5e-02b1bfaa0cfb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.037s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9098383-67b6-4224-858c-d50766665026]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3f3a2c-4f7d-4b53-a9aa-43541eb91482]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:07:49 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:07:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b7611e-57ff-4a61-b5b5-13266aa8d5d4]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG os_brick.utils [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:07:49 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Updating existing volume attachment record: 42a3e7c4-8421-4daf-a32a-8a0904c330c3 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:07:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:07:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:07:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:07:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:07:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:07:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:07:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:01 user nova-compute[74278]: INFO nova.compute.manager [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Detaching volume 1487bc7d-c642-4d94-b6ca-265826cb91b0
Oct 30 11:08:01 user nova-compute[74278]: INFO nova.virt.block_device [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Attempting to driver detach volume 1487bc7d-c642-4d94-b6ca-265826cb91b0 from mountpoint /dev/vdb
Oct 30 11:08:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Attempting to detach device vdb from instance f35f1e59-504e-42d2-9d50-f14a32844bdb from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:08:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:08:01 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:08:01 user nova-compute[74278]:   <source dev="/dev/sdd"/>
Oct 30 11:08:01 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:08:01 user nova-compute[74278]:   <serial>1487bc7d-c642-4d94-b6ca-265826cb91b0</serial>
Oct 30 11:08:01 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:08:01 user nova-compute[74278]: </disk>
Oct 30 11:08:01 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:08:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Successfully detached device vdb from instance f35f1e59-504e-42d2-9d50-f14a32844bdb from the persistent domain config.
Oct 30 11:08:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f35f1e59-504e-42d2-9d50-f14a32844bdb from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:08:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:08:01 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:08:01 user nova-compute[74278]:   <source dev="/dev/sdd"/>
Oct 30 11:08:01 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:08:01 user nova-compute[74278]:   <serial>1487bc7d-c642-4d94-b6ca-265826cb91b0</serial>
Oct 30 11:08:01 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:08:01 user nova-compute[74278]: </disk>
Oct 30 11:08:01 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:08:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f35f1e59-504e-42d2-9d50-f14a32844bdb {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:08:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:08:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:08:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:08:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:08:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:08:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJxFiyNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:08:12 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:08:12 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:08:12 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6c23fa-7c2b-44b2-8a64-0850ae805c70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:08:12 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b0d1d-64fd-4541-9fb5-e37c6c7915df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228] added
Oct 30 11:08:12 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b872af-4577-488b-a06a-a6a0f97be28f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d482c8d-0540-448f-9a22-dc114c0f99ba]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJxFiyNt {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJxFiyNt" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f223222a-f511-427f-a68a-03c97657f13a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uJxFiyNt'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[61db1dfe-c2f8-4b79-a51a-f95bd5769031]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d615c078-b864-4bcd-8ec5-5708f7effa9d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbb69a3-b316-4681-94f2-fa335dba9d41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228, portal: 172.16.0.220,3260]
Oct 30 11:08:12 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228, portal: 172.16.0.220,3260] successful.
Oct 30 11:08:12 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d951e7-adaa-4feb-b281-33ace85c746c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d144df1-cc68-48d0-9b03-5b16d4233453]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)
Oct 30 11:08:12 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6428633a-4771-46a1-8604-8c203e5c9b20]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:08:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJxFiyNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:08:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:08:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '23734326630316632', 'path': '/dev/sde'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:08:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734326630316632', 'path': '/dev/sde'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:08:13 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid c5293f0b-eeaf-4180-9968-05e37211c6bd {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:08:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:08:13 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:08:13 user nova-compute[74278]:   <source dev="/dev/sde"/>
Oct 30 11:08:13 user nova-compute[74278]:   <target dev="vdc" bus="virtio"/>
Oct 30 11:08:13 user nova-compute[74278]:   <serial>99f23d90-26af-48fc-ab82-ac34191c5228</serial>
Oct 30 11:08:13 user nova-compute[74278]: </disk>
Oct 30 11:08:13 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:08:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:08:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:08:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:08:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:08:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] No VIF found with MAC fa:16:3e:1d:00:99, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:08:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eab06968-4e3e-43ef-97a4-8e38e3ba1cd5 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.865s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "290c5792-7212-4a44-bf02-b51133a118ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:08:16 user nova-compute[74278]: INFO nova.compute.claims [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Claim successful on node user
Oct 30 11:08:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:16 user nova-compute[74278]: INFO nova.compute.manager [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Detaching volume 5f581754-1df5-486f-9cc3-ca226c023fa9
Oct 30 11:08:16 user nova-compute[74278]: INFO nova.virt.block_device [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Attempting to driver detach volume 5f581754-1df5-486f-9cc3-ca226c023fa9 from mountpoint /dev/vdb
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Attempting to detach device vdb from instance c5293f0b-eeaf-4180-9968-05e37211c6bd from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:08:16 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:08:16 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:08:16 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:08:16 user nova-compute[74278]:   <serial>5f581754-1df5-486f-9cc3-ca226c023fa9</serial>
Oct 30 11:08:16 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:08:16 user nova-compute[74278]: </disk>
Oct 30 11:08:16 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:08:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully detached device vdb from instance c5293f0b-eeaf-4180-9968-05e37211c6bd from the persistent domain config.
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c5293f0b-eeaf-4180-9968-05e37211c6bd from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:08:16 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:08:16 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:08:16 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:08:16 user nova-compute[74278]:   <serial>5f581754-1df5-486f-9cc3-ca226c023fa9</serial>
Oct 30 11:08:16 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:08:16 user nova-compute[74278]: </disk>
Oct 30 11:08:16 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.network.neutron [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:08:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.policy [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '584de218cec24240a91845deca515efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31dd01e2d9be4a0b96e94493f8eb43d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c5293f0b-eeaf-4180-9968-05e37211c6bd {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:08:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Creating image(s)
Oct 30 11:08:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "/opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "/opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "/opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.193s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk 1073741824" returned: 0 in 0.063s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Successfully created port: 8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Cannot resize image /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Ensure instance console log exists: /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Successfully updated port: 8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquired lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-fe9679d3-292b-43e6-b412-037211793d8b req-702ffcce-9fa7-450a-9e18-79a9921edf58 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-changed-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-fe9679d3-292b-43e6-b412-037211793d8b req-702ffcce-9fa7-450a-9e18-79a9921edf58 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Refreshing instance network info cache due to event network-changed-8eba06a8-c7a5-478f-8924-bc26b35789c7. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fe9679d3-292b-43e6-b412-037211793d8b req-702ffcce-9fa7-450a-9e18-79a9921edf58 service nova] Acquiring lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updating instance_info_cache with network_info: [{"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Releasing lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Instance network_info: |[{"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fe9679d3-292b-43e6-b412-037211793d8b req-702ffcce-9fa7-450a-9e18-79a9921edf58 service nova] Acquired lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:08:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-fe9679d3-292b-43e6-b412-037211793d8b req-702ffcce-9fa7-450a-9e18-79a9921edf58 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Refreshing network info cache for port 8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Start _get_guest_xml network_info=[{"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:08:19 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:08:19 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1860907579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1860907579',id=35,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFztOITLCEzqku21cyYAqalG2M4MjHC5UyyK86MtvbzG9S3kb5fO7HAXi5Tf60HBBPdXMmXKdFP3tSLiQbRQcZqjkBRAaao6856gtutBal3xNcRO8Ff2vYGxE8xRxbenA==',key_name='tempest-keypair-1069109495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31dd01e2d9be4a0b96e94493f8eb43d7',ramdisk_id='',reservation_id='r-zqi01yl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2142703659',owner_user_name='tempest-AttachVolumeShelveTestJSON-2142703659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584de218cec24240a91845deca515efa',uuid=290c5792-7212-4a44-bf02-b51133a118ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converting VIF {"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.objects.instance [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'pci_devices' on Instance uuid 290c5792-7212-4a44-bf02-b51133a118ed {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:08:19 user nova-compute[74278]:   <uuid>290c5792-7212-4a44-bf02-b51133a118ed</uuid>
Oct 30 11:08:19 user nova-compute[74278]:   <name>instance-00000023</name>
Oct 30 11:08:19 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:08:19 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:08:19 user nova-compute[74278]:   <metadata>
Oct 30 11:08:19 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:08:19 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:08:19 user nova-compute[74278]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1860907579</nova:name>
Oct 30 11:08:19 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:08:19</nova:creationTime>
Oct 30 11:08:19 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:08:19 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:08:19 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:08:19 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:08:19 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:08:19 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:08:19 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:08:19 user nova-compute[74278]:       <nova:owner>
Oct 30 11:08:19 user nova-compute[74278]:         <nova:user uuid="584de218cec24240a91845deca515efa">tempest-AttachVolumeShelveTestJSON-2142703659-project-member</nova:user>
Oct 30 11:08:19 user nova-compute[74278]:         <nova:project uuid="31dd01e2d9be4a0b96e94493f8eb43d7">tempest-AttachVolumeShelveTestJSON-2142703659</nova:project>
Oct 30 11:08:19 user nova-compute[74278]:       </nova:owner>
Oct 30 11:08:19 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:08:19 user nova-compute[74278]:       <nova:ports>
Oct 30 11:08:19 user nova-compute[74278]:         <nova:port uuid="8eba06a8-c7a5-478f-8924-bc26b35789c7">
Oct 30 11:08:19 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 11:08:19 user nova-compute[74278]:         </nova:port>
Oct 30 11:08:19 user nova-compute[74278]:       </nova:ports>
Oct 30 11:08:19 user nova-compute[74278]:     </nova:instance>
Oct 30 11:08:19 user nova-compute[74278]:   </metadata>
Oct 30 11:08:19 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:08:19 user nova-compute[74278]:     <system>
Oct 30 11:08:19 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:08:19 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:08:19 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:08:19 user nova-compute[74278]:       <entry name="serial">290c5792-7212-4a44-bf02-b51133a118ed</entry>
Oct 30 11:08:19 user nova-compute[74278]:       <entry name="uuid">290c5792-7212-4a44-bf02-b51133a118ed</entry>
Oct 30 11:08:19 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:08:19 user nova-compute[74278]:     </system>
Oct 30 11:08:19 user nova-compute[74278]:   </sysinfo>
Oct 30 11:08:19 user nova-compute[74278]:   <os>
Oct 30 11:08:19 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:08:19 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:08:19 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:08:19 user nova-compute[74278]:   </os>
Oct 30 11:08:19 user nova-compute[74278]:   <features>
Oct 30 11:08:19 user nova-compute[74278]:     <acpi/>
Oct 30 11:08:19 user nova-compute[74278]:     <apic/>
Oct 30 11:08:19 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:08:19 user nova-compute[74278]:   </features>
Oct 30 11:08:19 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:08:19 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:08:19 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:08:19 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:08:19 user nova-compute[74278]:   </clock>
Oct 30 11:08:19 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:08:19 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:08:19 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:08:19 user nova-compute[74278]:   </cpu>
Oct 30 11:08:19 user nova-compute[74278]:   <devices>
Oct 30 11:08:19 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:08:19 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:08:19 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk"/>
Oct 30 11:08:19 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:08:19 user nova-compute[74278]:     </disk>
Oct 30 11:08:19 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:08:19 user nova-compute[74278]:       <mac address="fa:16:3e:ca:66:3b"/>
Oct 30 11:08:19 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:08:19 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:08:19 user nova-compute[74278]:       <target dev="tap8eba06a8-c7"/>
Oct 30 11:08:19 user nova-compute[74278]:     </interface>
Oct 30 11:08:19 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:08:19 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/console.log" append="off"/>
Oct 30 11:08:19 user nova-compute[74278]:     </serial>
Oct 30 11:08:19 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:08:19 user nova-compute[74278]:     <video>
Oct 30 11:08:19 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:08:19 user nova-compute[74278]:     </video>
Oct 30 11:08:19 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:08:19 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:08:19 user nova-compute[74278]:     </rng>
Oct 30 11:08:19 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:08:19 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:08:19 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:08:19 user nova-compute[74278]:     </memballoon>
Oct 30 11:08:19 user nova-compute[74278]:   </devices>
Oct 30 11:08:19 user nova-compute[74278]: </domain>
Oct 30 11:08:19 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1860907579',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1860907579',id=35,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFztOITLCEzqku21cyYAqalG2M4MjHC5UyyK86MtvbzG9S3kb5fO7HAXi5Tf60HBBPdXMmXKdFP3tSLiQbRQcZqjkBRAaao6856gtutBal3xNcRO8Ff2vYGxE8xRxbenA==',key_name='tempest-keypair-1069109495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31dd01e2d9be4a0b96e94493f8eb43d7',ramdisk_id='',reservation_id='r-zqi01yl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2142703659',owner_user_name='tempest-AttachVolumeShelveTestJSON-2142703659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584de218cec24240a91845deca515efa',uuid=290c5792-7212-4a44-bf02-b51133a118ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converting VIF {"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG os_vif [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1787521f-8372-5a3f-abfa-a508544673ea', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eba06a8-c7, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8eba06a8-c7, col_values=(('qos', UUID('483a36cd-3327-4c60-83df-5edaa3dcd3d7')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8eba06a8-c7, col_values=(('external_ids', {'iface-id': '8eba06a8-c7a5-478f-8924-bc26b35789c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:66:3b', 'vm-uuid': '290c5792-7212-4a44-bf02-b51133a118ed'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:19 user nova-compute[74278]: INFO os_vif [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7')
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] No VIF found with MAC fa:16:3e:ca:66:3b, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.network.neutron [req-fe9679d3-292b-43e6-b412-037211793d8b req-702ffcce-9fa7-450a-9e18-79a9921edf58 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updated VIF entry in instance network info cache for port 8eba06a8-c7a5-478f-8924-bc26b35789c7. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG nova.network.neutron [req-fe9679d3-292b-43e6-b412-037211793d8b req-702ffcce-9fa7-450a-9e18-79a9921edf58 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updating instance_info_cache with network_info: [{"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-fe9679d3-292b-43e6-b412-037211793d8b req-702ffcce-9fa7-450a-9e18-79a9921edf58 service nova] Releasing lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:08:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-995dde6e-3edd-43a5-812e-0263db7c8965 req-6c2566e7-0929-4614-ae4a-6be3da46d076 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:08:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-995dde6e-3edd-43a5-812e-0263db7c8965 req-6c2566e7-0929-4614-ae4a-6be3da46d076 service nova] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-995dde6e-3edd-43a5-812e-0263db7c8965 req-6c2566e7-0929-4614-ae4a-6be3da46d076 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-995dde6e-3edd-43a5-812e-0263db7c8965 req-6c2566e7-0929-4614-ae4a-6be3da46d076 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-995dde6e-3edd-43a5-812e-0263db7c8965 req-6c2566e7-0929-4614-ae4a-6be3da46d076 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] No waiting events found dispatching network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:08:20 user nova-compute[74278]: WARNING nova.compute.manager [req-995dde6e-3edd-43a5-812e-0263db7c8965 req-6c2566e7-0929-4614-ae4a-6be3da46d076 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received unexpected event network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 for instance with vm_state building and task_state spawning.
Oct 30 11:08:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "6d868c1e-1985-48b6-a881-4d17b364701a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:21 user nova-compute[74278]: INFO nova.compute.manager [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Terminating instance
Oct 30 11:08:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-2b9689d5-b857-4d5f-a16a-3ce4d76a9e33 req-83bdc5d9-786d-4c96-a62a-602f522853dc service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-unplugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2b9689d5-b857-4d5f-a16a-3ce4d76a9e33 req-83bdc5d9-786d-4c96-a62a-602f522853dc service nova] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2b9689d5-b857-4d5f-a16a-3ce4d76a9e33 req-83bdc5d9-786d-4c96-a62a-602f522853dc service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2b9689d5-b857-4d5f-a16a-3ce4d76a9e33 req-83bdc5d9-786d-4c96-a62a-602f522853dc service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-2b9689d5-b857-4d5f-a16a-3ce4d76a9e33 req-83bdc5d9-786d-4c96-a62a-602f522853dc service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] No waiting events found dispatching network-vif-unplugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-2b9689d5-b857-4d5f-a16a-3ce4d76a9e33 req-83bdc5d9-786d-4c96-a62a-602f522853dc service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-unplugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Instance destroyed successfully.
Oct 30 11:08:22 user nova-compute[74278]: DEBUG nova.objects.instance [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'resources' on Instance uuid 6d868c1e-1985-48b6-a881-4d17b364701a {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-830327174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-830327174',id=29,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:04:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-b80tqbwr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:06:35Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=6d868c1e-1985-48b6-a881-4d17b364701a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "address": "fa:16:3e:64:13:1b", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c0e1514-8d", "ovs_interfaceid": "1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c0e1514-8d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_vif [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c0e1514-8d') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c0e1514-8d, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a32b4753-d303-44e2-aa78-ccf83af6d65b) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:22 user nova-compute[74278]: INFO os_vif [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:13:1b,bridge_name='br-int',has_traffic_filtering=True,id=1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c0e1514-8d')
Oct 30 11:08:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NCSOnfXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:08:22 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9c42c8-e762-42a3-bbd7-603013c84cf6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:08:22 user nova-compute[74278]: No targets found.
Oct 30 11:08:22 user nova-compute[74278]: iSNS:
Oct 30 11:08:22 user nova-compute[74278]: No targets found.
Oct 30 11:08:22 user nova-compute[74278]: STATIC:
Oct 30 11:08:22 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228
Oct 30 11:08:22 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:08:22 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:08:22 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3
Oct 30 11:08:22 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:08:22 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:08:22 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0
Oct 30 11:08:22 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:08:22 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:08:22 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:08:22 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:08:22 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:08:22 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9
Oct 30 11:08:22 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:08:22 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:08:22 user nova-compute[74278]: FIRMWARE:
Oct 30 11:08:22 user nova-compute[74278]: No targets found.
Oct 30 11:08:22 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:08:22 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:08:22 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3804bc2e-6e87-4523-8b2d-8ab59f170abc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da20b28-3456-4b58-ae2e-ee2506e82176]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c59b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a339b30c-ec72-4cc9-a773-611ef822f642]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f35f1e59-504e-42d2-9d50-f14a32844bdb is timed out.
Oct 30 11:08:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Successfully detached device vdb from instance f35f1e59-504e-42d2-9d50-f14a32844bdb from the live domain config.
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIHyoPVb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:08:22 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0a55c7-60fe-4f6a-a479-793714f4773d]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c6c2df-85f8-4d95-8b93-9de6c71da63b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e34bb42-ed8e-41a3-8493-f5feec90df36]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23966616337366131', '/dev/disk/by-id/scsi-1SCST_BIO24b31f06-9fac76a18c98cefe', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_24b31f06') {{(pid=85487) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99e75a5-7a05-450d-98b7-5577a847a649]: (4, None) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8380f0f9-1361-453c-91c9-8bf3e999d262]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9653b6-c389-46cf-a752-0ab67b906934]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3, portal: 172.16.0.220,3260]
Oct 30 11:08:22 user nova-compute[74278]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3, portal: 172.16.0.220,3260] successful.
Oct 30 11:08:22 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4984245f-1520-4324-898f-ab595bc0beb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed277302-81f6-4a3f-8c50-d4fe75203ce7]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] <== disconnect_volume: return (417ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:08:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Deleting instance files /opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a_del
Oct 30 11:08:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Deletion of /opt/stack/data/nova/instances/6d868c1e-1985-48b6-a881-4d17b364701a_del complete
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.242s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[59475b4f-d23f-45a9-b506-2f164d199f94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:08:22 user nova-compute[74278]: No targets found.
Oct 30 11:08:22 user nova-compute[74278]: iSNS:
Oct 30 11:08:22 user nova-compute[74278]: No targets found.
Oct 30 11:08:22 user nova-compute[74278]: STATIC:
Oct 30 11:08:22 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228
Oct 30 11:08:22 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:08:22 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:08:22 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0
Oct 30 11:08:22 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:08:22 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:08:22 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:08:22 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:08:22 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:08:22 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9
Oct 30 11:08:22 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:08:22 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:08:22 user nova-compute[74278]: FIRMWARE:
Oct 30 11:08:22 user nova-compute[74278]: No targets found.
Oct 30 11:08:22 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:08:22 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:08:22 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[60991d47-0df4-444c-920d-d14de33b24e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5085ff-8622-4628-bab9-3223876fe70c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)
Oct 30 11:08:22 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c116b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0'): ({'sdd'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Removing single pathed devices sdd {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[685d8719-26c6-4771-bc3d-5d348792e7c5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b0b51f-0377-4444-8384-6bfcd7845d80]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Flushing IO for device /dev/sdd {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac39ca7-0b4f-494e-832e-a47c298eed57]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: INFO nova.compute.manager [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Took 1.50 seconds to destroy the instance on the hypervisor.
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[847530f0-b7fa-4910-a58e-7f01a3e46a5d]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[940582a8-ba76-4b37-a9a2-671fd7f9b6ca]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86d6228-fc6b-4c00-a781-710086498571]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0, portal: 172.16.0.220,3260]
Oct 30 11:08:22 user nova-compute[74278]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0, portal: 172.16.0.220,3260] successful.
Oct 30 11:08:22 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1487bc7d-c642-4d94-b6ca-265826cb91b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2a21fe-ff6f-43f8-bb57-103ebc1f0e90]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] <== disconnect_volume: return (610ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-b139893f-e6b4-4c4c-8b4b-b5d39da0bd94 req-4dc5019d-26fa-46c7-b594-d093d09605d3 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b139893f-e6b4-4c4c-8b4b-b5d39da0bd94 req-4dc5019d-26fa-46c7-b594-d093d09605d3 service nova] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b139893f-e6b4-4c4c-8b4b-b5d39da0bd94 req-4dc5019d-26fa-46c7-b594-d093d09605d3 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b139893f-e6b4-4c4c-8b4b-b5d39da0bd94 req-4dc5019d-26fa-46c7-b594-d093d09605d3 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-b139893f-e6b4-4c4c-8b4b-b5d39da0bd94 req-4dc5019d-26fa-46c7-b594-d093d09605d3 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] No waiting events found dispatching network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:08:22 user nova-compute[74278]: WARNING nova.compute.manager [req-b139893f-e6b4-4c4c-8b4b-b5d39da0bd94 req-4dc5019d-26fa-46c7-b594-d093d09605d3 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received unexpected event network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 for instance with vm_state building and task_state spawning.
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:08:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Instance spawned successfully.
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:08:23 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Took 0.62 seconds to deallocate network for instance.
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:08:23 user nova-compute[74278]: INFO nova.compute.manager [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Took 6.68 seconds to spawn the instance on the hypervisor.
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:08:23 user nova-compute[74278]: INFO nova.compute.manager [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Took 7.57 seconds to build instance.
Oct 30 11:08:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-369fb3b3-5ee0-4cff-a158-0790e46d248f tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "290c5792-7212-4a44-bf02-b51133a118ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.705s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-8b771809-e629-4b2d-84bb-f69d46d2904e req-4f26b1a1-3b86-4354-a74f-7cedf9f03615 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:08:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8b771809-e629-4b2d-84bb-f69d46d2904e req-4f26b1a1-3b86-4354-a74f-7cedf9f03615 service nova] Acquiring lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8b771809-e629-4b2d-84bb-f69d46d2904e req-4f26b1a1-3b86-4354-a74f-7cedf9f03615 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8b771809-e629-4b2d-84bb-f69d46d2904e req-4f26b1a1-3b86-4354-a74f-7cedf9f03615 service nova] Lock "6d868c1e-1985-48b6-a881-4d17b364701a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-8b771809-e629-4b2d-84bb-f69d46d2904e req-4f26b1a1-3b86-4354-a74f-7cedf9f03615 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] No waiting events found dispatching network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:08:23 user nova-compute[74278]: WARNING nova.compute.manager [req-8b771809-e629-4b2d-84bb-f69d46d2904e req-4f26b1a1-3b86-4354-a74f-7cedf9f03615 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received unexpected event network-vif-plugged-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b for instance with vm_state active and task_state deleting.
Oct 30 11:08:24 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lazy-loading 'flavor' on Instance uuid f35f1e59-504e-42d2-9d50-f14a32844bdb {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:08:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1fff80f4-53e1-4bd1-8a53-8bb3e83bf1e8 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.527s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:24 user nova-compute[74278]: INFO nova.compute.manager [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Took 1.07 seconds to detach 1 volumes for instance.
Oct 30 11:08:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:24 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:08:24 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:08:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:24 user nova-compute[74278]: DEBUG nova.compute.manager [req-bfea5fbf-1a69-4544-8ef1-8304911e6d8b req-649ba22a-59a2-424d-802e-1d07d8d6ce25 service nova] [instance: 6d868c1e-1985-48b6-a881-4d17b364701a] Received event network-vif-deleted-1c0e1514-8df1-4264-a58c-dc2a7ee3cb0b {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:08:24 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Deleted allocations for instance 6d868c1e-1985-48b6-a881-4d17b364701a
Oct 30 11:08:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-897be2be-ea3d-4e18-801d-673ec2485731 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "6d868c1e-1985-48b6-a881-4d17b364701a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.856s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:29 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:08:31 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:08:31 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:08:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:08:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:32 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:08:32 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:08:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-64287717-7d3b-4087-aedf-faf87be774a8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:08:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-64287717-7d3b-4087-aedf-faf87be774a8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:08:32 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:08:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:33 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Updating instance_info_cache with network_info: [{"id": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "address": "fa:16:3e:7d:e1:79", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd8caf3-4c", "ovs_interfaceid": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:08:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-64287717-7d3b-4087-aedf-faf87be774a8" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:08:33 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:08:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:08:34 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:08:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:35 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:08:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:36 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c5293f0b-eeaf-4180-9968-05e37211c6bd is timed out.
Oct 30 11:08:36 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully detached device vdb from instance c5293f0b-eeaf-4180-9968-05e37211c6bd from the live domain config.
Oct 30 11:08:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SwEQTGxm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:08:36 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:08:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c00e80-f036-4063-b2ff-1722651341f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:08:36 user nova-compute[74278]: No targets found.
Oct 30 11:08:36 user nova-compute[74278]: iSNS:
Oct 30 11:08:36 user nova-compute[74278]: No targets found.
Oct 30 11:08:36 user nova-compute[74278]: STATIC:
Oct 30 11:08:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228
Oct 30 11:08:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:08:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:08:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:08:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:08:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:08:36 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9
Oct 30 11:08:36 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:08:36 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:08:36 user nova-compute[74278]: FIRMWARE:
Oct 30 11:08:36 user nova-compute[74278]: No targets found.
Oct 30 11:08:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:08:36 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:08:36 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e16b51-390b-4455-9449-06831ffd4d70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47cfde2-e4a1-4117-825e-b822695846aa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:08:36 user nova-compute[74278]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)
Oct 30 11:08:36 user nova-compute[74278]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)
Oct 30 11:08:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:08:36 user nova-compute[74278]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 (non-flash)
Oct 30 11:08:36 user nova-compute[74278]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)
Oct 30 11:08:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c133a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[34993d1a-a9cb-4f2f-a3b0-0a5e6459f58e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ef5b3f-fd83-4eab-9c23-363d5bef6b98]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2cfc1b-2d2f-47e4-bb4b-88e22af55480]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0289077-8801-40f8-b5fd-08a1a6e94831]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3171977-1a6e-4579-b97c-eabab9619698]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd8c144-a7d9-48e6-a0ab-d448a85dff54]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9, portal: 172.16.0.220,3260]
Oct 30 11:08:37 user nova-compute[74278]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9, portal: 172.16.0.220,3260] successful.
Oct 30 11:08:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f581754-1df5-486f-9cc3-ca226c023fa9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa8c413-2b67-463f-876b-7e1a177484fc]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.466s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] <== disconnect_volume: return (469ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:38 user nova-compute[74278]: DEBUG nova.objects.instance [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid c5293f0b-eeaf-4180-9968-05e37211c6bd {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:08:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-27dce5e2-d33c-49b6-909a-72db4fbcc698 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.442s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:08:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:08:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:39 user nova-compute[74278]: INFO nova.compute.manager [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Detaching volume 99f23d90-26af-48fc-ab82-ac34191c5228
Oct 30 11:08:39 user nova-compute[74278]: INFO nova.virt.block_device [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Attempting to driver detach volume 99f23d90-26af-48fc-ab82-ac34191c5228 from mountpoint /dev/vdc
Oct 30 11:08:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Attempting to detach device vdc from instance c5293f0b-eeaf-4180-9968-05e37211c6bd from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:08:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:08:39 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:08:39 user nova-compute[74278]:   <source dev="/dev/sde"/>
Oct 30 11:08:39 user nova-compute[74278]:   <target dev="vdc" bus="virtio"/>
Oct 30 11:08:39 user nova-compute[74278]:   <serial>99f23d90-26af-48fc-ab82-ac34191c5228</serial>
Oct 30 11:08:39 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 11:08:39 user nova-compute[74278]: </disk>
Oct 30 11:08:39 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:08:39 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully detached device vdc from instance c5293f0b-eeaf-4180-9968-05e37211c6bd from the persistent domain config.
Oct 30 11:08:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c5293f0b-eeaf-4180-9968-05e37211c6bd from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:08:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:08:39 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:08:39 user nova-compute[74278]:   <source dev="/dev/sde"/>
Oct 30 11:08:39 user nova-compute[74278]:   <target dev="vdc" bus="virtio"/>
Oct 30 11:08:39 user nova-compute[74278]:   <serial>99f23d90-26af-48fc-ab82-ac34191c5228</serial>
Oct 30 11:08:39 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 11:08:39 user nova-compute[74278]: </disk>
Oct 30 11:08:39 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:08:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:08:39 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c5293f0b-eeaf-4180-9968-05e37211c6bd {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:08:40 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:08:40 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7960MB free_disk=24.820327758789062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 64287717-7d3b-4087-aedf-faf87be774a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance f35f1e59-504e-42d2-9d50-f14a32844bdb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance c5293f0b-eeaf-4180-9968-05e37211c6bd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 290c5792-7212-4a44-bf02-b51133a118ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:08:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:08:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:08:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:52 user nova-compute[74278]: INFO nova.compute.manager [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Terminating instance
Oct 30 11:08:52 user nova-compute[74278]: DEBUG nova.compute.manager [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG nova.compute.manager [req-7dfa5e8e-35f2-426a-96d9-743bbfa4017e req-dd6acc80-a5d7-480b-a5b2-eb27d223c2bf service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Received event network-vif-unplugged-333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7dfa5e8e-35f2-426a-96d9-743bbfa4017e req-dd6acc80-a5d7-480b-a5b2-eb27d223c2bf service nova] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7dfa5e8e-35f2-426a-96d9-743bbfa4017e req-dd6acc80-a5d7-480b-a5b2-eb27d223c2bf service nova] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7dfa5e8e-35f2-426a-96d9-743bbfa4017e req-dd6acc80-a5d7-480b-a5b2-eb27d223c2bf service nova] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG nova.compute.manager [req-7dfa5e8e-35f2-426a-96d9-743bbfa4017e req-dd6acc80-a5d7-480b-a5b2-eb27d223c2bf service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] No waiting events found dispatching network-vif-unplugged-333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:08:52 user nova-compute[74278]: DEBUG nova.compute.manager [req-7dfa5e8e-35f2-426a-96d9-743bbfa4017e req-dd6acc80-a5d7-480b-a5b2-eb27d223c2bf service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Received event network-vif-unplugged-333767b9-356d-47ab-a72e-6ef22262c57f for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:08:53 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Instance destroyed successfully.
Oct 30 11:08:53 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lazy-loading 'resources' on Instance uuid f35f1e59-504e-42d2-9d50-f14a32844bdb {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:04:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-233606836',display_name='tempest-TestServerVolumeAttachmentScenario-server-233606836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-233606836',id=32,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwjfSBawd3W8neyYy5JeGS6/9+toBHTZU5JnOYq2WL2j69DiLBbUzUuaS67uxNqlhR00xozPYjlduNMlOsqnzoW1Ct+UrMTlreUILwRIadtQQKYWthzJFpY+jcAU3XKYQ==',key_name='tempest-keypair-419545702',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:04:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f53b83164364a24a93f397e578d1ad8',ramdisk_id='',reservation_id='r-67is2ysi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1265312722',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1265312722-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20d49847983f430a86128dee0046385f',uuid=f35f1e59-504e-42d2-9d50-f14a32844bdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "333767b9-356d-47ab-a72e-6ef22262c57f", "address": "fa:16:3e:6f:fb:3d", "network": {"id": "4bcb592e-43df-4f4a-bb74-03b24c1795ef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1818877804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f53b83164364a24a93f397e578d1ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333767b9-35", "ovs_interfaceid": "333767b9-356d-47ab-a72e-6ef22262c57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Converting VIF {"id": "333767b9-356d-47ab-a72e-6ef22262c57f", "address": "fa:16:3e:6f:fb:3d", "network": {"id": "4bcb592e-43df-4f4a-bb74-03b24c1795ef", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1818877804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f53b83164364a24a93f397e578d1ad8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap333767b9-35", "ovs_interfaceid": "333767b9-356d-47ab-a72e-6ef22262c57f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fb:3d,bridge_name='br-int',has_traffic_filtering=True,id=333767b9-356d-47ab-a72e-6ef22262c57f,network=Network(4bcb592e-43df-4f4a-bb74-03b24c1795ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333767b9-35') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG os_vif [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fb:3d,bridge_name='br-int',has_traffic_filtering=True,id=333767b9-356d-47ab-a72e-6ef22262c57f,network=Network(4bcb592e-43df-4f4a-bb74-03b24c1795ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333767b9-35') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap333767b9-35, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ee51e9b-ef71-4e28-9f49-b770bd41ddcb) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:53 user nova-compute[74278]: INFO os_vif [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fb:3d,bridge_name='br-int',has_traffic_filtering=True,id=333767b9-356d-47ab-a72e-6ef22262c57f,network=Network(4bcb592e-43df-4f4a-bb74-03b24c1795ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap333767b9-35')
Oct 30 11:08:53 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Deleting instance files /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb_del
Oct 30 11:08:53 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Deletion of /opt/stack/data/nova/instances/f35f1e59-504e-42d2-9d50-f14a32844bdb_del complete
Oct 30 11:08:53 user nova-compute[74278]: INFO nova.compute.manager [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 30 11:08:53 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:08:53 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:08:54 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:08:54 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Took 1.25 seconds to deallocate network for instance.
Oct 30 11:08:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-0395c039-41a0-41d2-9918-0a34f49f7bad req-dcca32aa-6366-48bd-a7fc-9d41262efa1b service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Received event network-vif-deleted-333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:08:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-c4554305-01d2-4a60-b2df-7c015b49a740 req-efcdb0e1-59b8-431d-bb14-6ef2f51c62cc service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Received event network-vif-plugged-333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:08:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c4554305-01d2-4a60-b2df-7c015b49a740 req-efcdb0e1-59b8-431d-bb14-6ef2f51c62cc service nova] Acquiring lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:08:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c4554305-01d2-4a60-b2df-7c015b49a740 req-efcdb0e1-59b8-431d-bb14-6ef2f51c62cc service nova] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:08:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c4554305-01d2-4a60-b2df-7c015b49a740 req-efcdb0e1-59b8-431d-bb14-6ef2f51c62cc service nova] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-c4554305-01d2-4a60-b2df-7c015b49a740 req-efcdb0e1-59b8-431d-bb14-6ef2f51c62cc service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] No waiting events found dispatching network-vif-plugged-333767b9-356d-47ab-a72e-6ef22262c57f {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:08:54 user nova-compute[74278]: WARNING nova.compute.manager [req-c4554305-01d2-4a60-b2df-7c015b49a740 req-efcdb0e1-59b8-431d-bb14-6ef2f51c62cc service nova] [instance: f35f1e59-504e-42d2-9d50-f14a32844bdb] Received unexpected event network-vif-plugged-333767b9-356d-47ab-a72e-6ef22262c57f for instance with vm_state deleted and task_state None.
Oct 30 11:08:54 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:08:54 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:08:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:54 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Deleted allocations for instance f35f1e59-504e-42d2-9d50-f14a32844bdb
Oct 30 11:08:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:08:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e306a007-e004-4443-8087-fa3f3fdfbfe1 tempest-TestServerVolumeAttachmentScenario-1265312722 tempest-TestServerVolumeAttachmentScenario-1265312722-project-member] Lock "f35f1e59-504e-42d2-9d50-f14a32844bdb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.471s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:08:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:00 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c5293f0b-eeaf-4180-9968-05e37211c6bd is timed out.
Oct 30 11:09:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully detached device vdc from instance c5293f0b-eeaf-4180-9968-05e37211c6bd from the live domain config.
Oct 30 11:09:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJxFiyNt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:09:00 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ac7a67-9272-4648-92cc-cbb8b9a16b74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8537a689-1917-4fe3-8646-b7d86ac8d513\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:09:00 user nova-compute[74278]: No targets found.
Oct 30 11:09:00 user nova-compute[74278]: iSNS:
Oct 30 11:09:00 user nova-compute[74278]: No targets found.
Oct 30 11:09:00 user nova-compute[74278]: STATIC:
Oct 30 11:09:00 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228
Oct 30 11:09:00 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:09:00 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:09:00 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:09:00 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:09:00 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:09:00 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:8537a689-1917-4fe3-8646-b7d86ac8d513
Oct 30 11:09:00 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:09:00 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:09:00 user nova-compute[74278]: FIRMWARE:
Oct 30 11:09:00 user nova-compute[74278]: No targets found.
Oct 30 11:09:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:09:00 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:09:00 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8845bd83-4701-4fe3-b0b9-18a5d6fcffa1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8537a689-1917-4fe3-8646-b7d86ac8d513\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58a893e-2e07-46ba-9255-2913de5c9f03]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8537a689-1917-4fe3-8646-b7d86ac8d513 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:09:00 user nova-compute[74278]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)
Oct 30 11:09:00 user nova-compute[74278]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8537a689-1917-4fe3-8646-b7d86ac8d513 (non-flash)
Oct 30 11:09:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:09:00 user nova-compute[74278]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 (non-flash)
Oct 30 11:09:00 user nova-compute[74278]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8537a689-1917-4fe3-8646-b7d86ac8d513 (non-flash)
Oct 30 11:09:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c1b7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228'): ({'sde'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Removing single pathed devices sde {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.070s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1dc08f-afda-41f4-8698-132185e2d914]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[967505c3-636c-45f1-bdd4-d64cabd82737]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Flushing IO for device /dev/sde {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9398e32a-bc76-4db7-b302-2164b3c3c61c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54b2bec-e065-4bfd-b93a-a12206458ead]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] SCSI volumes sde have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c109da-a75b-44b8-96e6-e9f6cfd5ee15]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d142019e-0073-49bb-95be-b1c59213efa1]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228, portal: 172.16.0.220,3260]
Oct 30 11:09:00 user nova-compute[74278]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228, portal: 172.16.0.220,3260] successful.
Oct 30 11:09:00 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99f23d90-26af-48fc-ab82-ac34191c5228 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3cd887-93f9-4aab-a580-4484a425ea99]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.490s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] <== disconnect_volume: return (492ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:09:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:09:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:03 user nova-compute[74278]: DEBUG nova.objects.instance [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'flavor' on Instance uuid c5293f0b-eeaf-4180-9968-05e37211c6bd {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:09:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-370fd05d-c9c6-4add-8334-d9fd51e972c6 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.667s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:04 user nova-compute[74278]: INFO nova.compute.manager [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Terminating instance
Oct 30 11:09:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:09:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-23cdbaf6-f5c9-43f3-b436-8f8fd7052fb8 req-c5092cc5-21e7-4abd-9b5b-f435e5cb51c0 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Received event network-vif-unplugged-9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-23cdbaf6-f5c9-43f3-b436-8f8fd7052fb8 req-c5092cc5-21e7-4abd-9b5b-f435e5cb51c0 service nova] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-23cdbaf6-f5c9-43f3-b436-8f8fd7052fb8 req-c5092cc5-21e7-4abd-9b5b-f435e5cb51c0 service nova] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-23cdbaf6-f5c9-43f3-b436-8f8fd7052fb8 req-c5092cc5-21e7-4abd-9b5b-f435e5cb51c0 service nova] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-23cdbaf6-f5c9-43f3-b436-8f8fd7052fb8 req-c5092cc5-21e7-4abd-9b5b-f435e5cb51c0 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] No waiting events found dispatching network-vif-unplugged-9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-23cdbaf6-f5c9-43f3-b436-8f8fd7052fb8 req-c5092cc5-21e7-4abd-9b5b-f435e5cb51c0 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Received event network-vif-unplugged-9ccd5489-aa26-43ed-a1a5-e1984cb4300a for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:09:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Instance destroyed successfully.
Oct 30 11:09:05 user nova-compute[74278]: DEBUG nova.objects.instance [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lazy-loading 'resources' on Instance uuid c5293f0b-eeaf-4180-9968-05e37211c6bd {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1605625300',display_name='tempest-AttachVolumeTestJSON-server-1605625300',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1605625300',id=33,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMEDzUr8As7KCc45r3j5vAhoATwrHi4gdgD90I7lcHvAGOWTdfJeaEiZtl+Bq90kIdrdeGWjZqWNK4nPs59MlxP1AWzYExB8MFqK6FJtDbp+dk+o+iMe7551TqONyIZAg==',key_name='tempest-keypair-1393981832',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:05:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='928164ecd5c44dddb93fbecfeaa44071',ramdisk_id='',reservation_id='r-2a66r2hw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2116287848',owner_user_name='tempest-AttachVolumeTestJSON-2116287848-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='525f98e0bed241fdad3962fda627b143',uuid=c5293f0b-eeaf-4180-9968-05e37211c6bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "address": "fa:16:3e:1d:00:99", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ccd5489-aa", "ovs_interfaceid": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converting VIF {"id": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "address": "fa:16:3e:1d:00:99", "network": {"id": "99a8234c-5757-48d0-ac80-844abebc3473", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090071467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "928164ecd5c44dddb93fbecfeaa44071", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ccd5489-aa", "ovs_interfaceid": "9ccd5489-aa26-43ed-a1a5-e1984cb4300a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:00:99,bridge_name='br-int',has_traffic_filtering=True,id=9ccd5489-aa26-43ed-a1a5-e1984cb4300a,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ccd5489-aa') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG os_vif [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:00:99,bridge_name='br-int',has_traffic_filtering=True,id=9ccd5489-aa26-43ed-a1a5-e1984cb4300a,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ccd5489-aa') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ccd5489-aa, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c83581fe-405d-4023-b2ba-c6f8a6ffa500) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:05 user nova-compute[74278]: INFO os_vif [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:00:99,bridge_name='br-int',has_traffic_filtering=True,id=9ccd5489-aa26-43ed-a1a5-e1984cb4300a,network=Network(99a8234c-5757-48d0-ac80-844abebc3473),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ccd5489-aa')
Oct 30 11:09:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Deleting instance files /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd_del
Oct 30 11:09:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Deletion of /opt/stack/data/nova/instances/c5293f0b-eeaf-4180-9968-05e37211c6bd_del complete
Oct 30 11:09:05 user nova-compute[74278]: INFO nova.compute.manager [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 30 11:09:05 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:09:05 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:09:07 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:09:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-61328f29-e7ac-4232-9e8c-e0e21e0edc9b req-b6c94465-4e5d-4bdf-b93e-60ba2efae3a7 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Received event network-vif-deleted-9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:07 user nova-compute[74278]: INFO nova.compute.manager [req-61328f29-e7ac-4232-9e8c-e0e21e0edc9b req-b6c94465-4e5d-4bdf-b93e-60ba2efae3a7 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Neutron deleted interface 9ccd5489-aa26-43ed-a1a5-e1984cb4300a; detaching it from the instance and deleting it from the info cache
Oct 30 11:09:07 user nova-compute[74278]: DEBUG nova.network.neutron [req-61328f29-e7ac-4232-9e8c-e0e21e0edc9b req-b6c94465-4e5d-4bdf-b93e-60ba2efae3a7 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:09:07 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Took 1.35 seconds to deallocate network for instance.
Oct 30 11:09:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-61328f29-e7ac-4232-9e8c-e0e21e0edc9b req-b6c94465-4e5d-4bdf-b93e-60ba2efae3a7 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Detach interface failed, port_id=9ccd5489-aa26-43ed-a1a5-e1984cb4300a, reason: Instance c5293f0b-eeaf-4180-9968-05e37211c6bd could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:09:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-3600cb20-0b76-41b7-804c-632c3fd9fe93 req-cec23eee-2d31-4db8-bf56-ac0047166d75 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Received event network-vif-plugged-9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3600cb20-0b76-41b7-804c-632c3fd9fe93 req-cec23eee-2d31-4db8-bf56-ac0047166d75 service nova] Acquiring lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3600cb20-0b76-41b7-804c-632c3fd9fe93 req-cec23eee-2d31-4db8-bf56-ac0047166d75 service nova] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3600cb20-0b76-41b7-804c-632c3fd9fe93 req-cec23eee-2d31-4db8-bf56-ac0047166d75 service nova] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-3600cb20-0b76-41b7-804c-632c3fd9fe93 req-cec23eee-2d31-4db8-bf56-ac0047166d75 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] No waiting events found dispatching network-vif-plugged-9ccd5489-aa26-43ed-a1a5-e1984cb4300a {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:09:07 user nova-compute[74278]: WARNING nova.compute.manager [req-3600cb20-0b76-41b7-804c-632c3fd9fe93 req-cec23eee-2d31-4db8-bf56-ac0047166d75 service nova] [instance: c5293f0b-eeaf-4180-9968-05e37211c6bd] Received unexpected event network-vif-plugged-9ccd5489-aa26-43ed-a1a5-e1984cb4300a for instance with vm_state deleted and task_state None.
Oct 30 11:09:07 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:09:07 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:09:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:07 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Deleted allocations for instance c5293f0b-eeaf-4180-9968-05e37211c6bd
Oct 30 11:09:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-7a986827-dbb4-4af1-8d73-f5a76c596e66 tempest-AttachVolumeTestJSON-2116287848 tempest-AttachVolumeTestJSON-2116287848-project-member] Lock "c5293f0b-eeaf-4180-9968-05e37211c6bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.923s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:09:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:08 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:09:08 user nova-compute[74278]: INFO nova.compute.claims [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Claim successful on node user
Oct 30 11:09:08 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:09:08 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:09:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:09:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:09:08 user nova-compute[74278]: DEBUG nova.network.neutron [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:09:08 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:09:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG nova.policy [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b92838c59a9488bb72de434b984abf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af9e783ec7f44a65b46dac4e2c11e5b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:09:09 user nova-compute[74278]: INFO nova.virt.block_device [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Booting with volume 9326cea9-3b72-4121-94cc-f2e6246f1108 at /dev/vda
Oct 30 11:09:09 user nova-compute[74278]: DEBUG os_brick.utils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20c4708-5b11-443d-974e-0fa4006c765a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c97464-4091-4828-b396-133662d9e85e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.097s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca2a081-80fb-4780-95d0-20d74b04975e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[64608120-bda5-4dc8-b815-39d8dfed7f9f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:09:09 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:09:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd2643f-8260-4a87-849d-7e5e57df955d]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG os_brick.utils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] <== get_connector_properties: return (235ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:09:09 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating existing volume attachment record: 075aa324-89fc-4bc5-9895-2214d9939319 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:09:10 user nova-compute[74278]: DEBUG nova.network.neutron [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Successfully created port: 1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:09:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG nova.network.neutron [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Successfully updated port: 1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquired lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG nova.network.neutron [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-68acae7a-71e5-4fb6-ad22-b534eb2848f9 req-b6063e0d-c9f0-48af-9b60-65efcb91a68f service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-changed-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-68acae7a-71e5-4fb6-ad22-b534eb2848f9 req-b6063e0d-c9f0-48af-9b60-65efcb91a68f service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Refreshing instance network info cache due to event network-changed-1491bcc7-6199-4857-a8b0-ad1efc591df5. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-68acae7a-71e5-4fb6-ad22-b534eb2848f9 req-b6063e0d-c9f0-48af-9b60-65efcb91a68f service nova] Acquiring lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG nova.network.neutron [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG nova.network.neutron [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating instance_info_cache with network_info: [{"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Releasing lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Instance network_info: |[{"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-68acae7a-71e5-4fb6-ad22-b534eb2848f9 req-b6063e0d-c9f0-48af-9b60-65efcb91a68f service nova] Acquired lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:09:11 user nova-compute[74278]: DEBUG nova.network.neutron [req-68acae7a-71e5-4fb6-ad22-b534eb2848f9 req-b6063e0d-c9f0-48af-9b60-65efcb91a68f service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Refreshing network info cache for port 1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG nova.network.neutron [req-68acae7a-71e5-4fb6-ad22-b534eb2848f9 req-b6063e0d-c9f0-48af-9b60-65efcb91a68f service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updated VIF entry in instance network info cache for port 1491bcc7-6199-4857-a8b0-ad1efc591df5. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG nova.network.neutron [req-68acae7a-71e5-4fb6-ad22-b534eb2848f9 req-b6063e0d-c9f0-48af-9b60-65efcb91a68f service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating instance_info_cache with network_info: [{"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-68acae7a-71e5-4fb6-ad22-b534eb2848f9 req-b6063e0d-c9f0-48af-9b60-65efcb91a68f service nova] Releasing lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "64287717-7d3b-4087-aedf-faf87be774a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "64287717-7d3b-4087-aedf-faf87be774a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "64287717-7d3b-4087-aedf-faf87be774a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "64287717-7d3b-4087-aedf-faf87be774a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "64287717-7d3b-4087-aedf-faf87be774a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:12 user nova-compute[74278]: INFO nova.compute.manager [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Terminating instance
Oct 30 11:09:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:12 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Instance destroyed successfully.
Oct 30 11:09:12 user nova-compute[74278]: DEBUG nova.objects.instance [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'resources' on Instance uuid 64287717-7d3b-4087-aedf-faf87be774a8 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:58:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-309301792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-309301792',id=22,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:59:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-ij0dgamr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:00:55Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=64287717-7d3b-4087-aedf-faf87be774a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "address": "fa:16:3e:7d:e1:79", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd8caf3-4c", "ovs_interfaceid": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "address": "fa:16:3e:7d:e1:79", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fd8caf3-4c", "ovs_interfaceid": "0fd8caf3-4c43-425d-95b8-47207d7d73be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:e1:79,bridge_name='br-int',has_traffic_filtering=True,id=0fd8caf3-4c43-425d-95b8-47207d7d73be,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd8caf3-4c') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG os_vif [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:e1:79,bridge_name='br-int',has_traffic_filtering=True,id=0fd8caf3-4c43-425d-95b8-47207d7d73be,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd8caf3-4c') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fd8caf3-4c, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e232b124-60b8-417a-9175-1f8f7e243c39) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:12 user nova-compute[74278]: INFO os_vif [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:e1:79,bridge_name='br-int',has_traffic_filtering=True,id=0fd8caf3-4c43-425d-95b8-47207d7d73be,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fd8caf3-4c')
Oct 30 11:09:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Deleting instance files /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8_del
Oct 30 11:09:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Deletion of /opt/stack/data/nova/instances/64287717-7d3b-4087-aedf-faf87be774a8_del complete
Oct 30 11:09:13 user nova-compute[74278]: INFO nova.compute.manager [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Took 0.77 seconds to destroy the instance on the hypervisor.
Oct 30 11:09:13 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-9d25cd9d-1142-4eb6-b6bf-38a12afe3e07 req-979ab58b-5bf4-4115-8035-269e03209cdd service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Received event network-vif-unplugged-0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9d25cd9d-1142-4eb6-b6bf-38a12afe3e07 req-979ab58b-5bf4-4115-8035-269e03209cdd service nova] Acquiring lock "64287717-7d3b-4087-aedf-faf87be774a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9d25cd9d-1142-4eb6-b6bf-38a12afe3e07 req-979ab58b-5bf4-4115-8035-269e03209cdd service nova] Lock "64287717-7d3b-4087-aedf-faf87be774a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9d25cd9d-1142-4eb6-b6bf-38a12afe3e07 req-979ab58b-5bf4-4115-8035-269e03209cdd service nova] Lock "64287717-7d3b-4087-aedf-faf87be774a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-9d25cd9d-1142-4eb6-b6bf-38a12afe3e07 req-979ab58b-5bf4-4115-8035-269e03209cdd service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] No waiting events found dispatching network-vif-unplugged-0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-9d25cd9d-1142-4eb6-b6bf-38a12afe3e07 req-979ab58b-5bf4-4115-8035-269e03209cdd service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Received event network-vif-unplugged-0fd8caf3-4c43-425d-95b8-47207d7d73be for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-9d25cd9d-1142-4eb6-b6bf-38a12afe3e07 req-979ab58b-5bf4-4115-8035-269e03209cdd service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Received event network-vif-plugged-0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9d25cd9d-1142-4eb6-b6bf-38a12afe3e07 req-979ab58b-5bf4-4115-8035-269e03209cdd service nova] Acquiring lock "64287717-7d3b-4087-aedf-faf87be774a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9d25cd9d-1142-4eb6-b6bf-38a12afe3e07 req-979ab58b-5bf4-4115-8035-269e03209cdd service nova] Lock "64287717-7d3b-4087-aedf-faf87be774a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9d25cd9d-1142-4eb6-b6bf-38a12afe3e07 req-979ab58b-5bf4-4115-8035-269e03209cdd service nova] Lock "64287717-7d3b-4087-aedf-faf87be774a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-9d25cd9d-1142-4eb6-b6bf-38a12afe3e07 req-979ab58b-5bf4-4115-8035-269e03209cdd service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] No waiting events found dispatching network-vif-plugged-0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:09:13 user nova-compute[74278]: WARNING nova.compute.manager [req-9d25cd9d-1142-4eb6-b6bf-38a12afe3e07 req-979ab58b-5bf4-4115-8035-269e03209cdd service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Received unexpected event network-vif-plugged-0fd8caf3-4c43-425d-95b8-47207d7d73be for instance with vm_state active and task_state deleting.
Oct 30 11:09:14 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:09:14 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Took 1.31 seconds to deallocate network for instance.
Oct 30 11:09:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:14 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:09:14 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:09:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:14 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Deleted allocations for instance 64287717-7d3b-4087-aedf-faf87be774a8
Oct 30 11:09:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fe032672-0893-4d4a-ac0d-ba8472142fd9 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "64287717-7d3b-4087-aedf-faf87be774a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.563s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-fbdc1fb3-5b9c-42a1-add8-055360377c5a req-9da8bcd5-5f39-4fd1-afe8-18b26224fef9 service nova] [instance: 64287717-7d3b-4087-aedf-faf87be774a8] Received event network-vif-deleted-0fd8caf3-4c43-425d-95b8-47207d7d73be {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Acquiring lock "a6704568-651d-4732-b272-79f0b768b96c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "a6704568-651d-4732-b272-79f0b768b96c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:09:18 user nova-compute[74278]: INFO nova.compute.claims [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Claim successful on node user
Oct 30 11:09:18 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:09:18 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:09:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:09:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:09:18 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Creating image(s)
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "/opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "/opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG nova.policy [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b733da53a9b94530a4a85b19e8af1a5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '821f55c16aa848729f8cc373347e5102', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.281s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.205s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk 1073741824" returned: 0 in 0.061s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Cannot resize image /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Ensure instance console log exists: /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:20 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Successfully created port: db77bda8-29ee-428e-809f-3d102d95a9dd {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:09:20 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Successfully updated port: db77bda8-29ee-428e-809f-3d102d95a9dd {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:09:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Acquiring lock "refresh_cache-a6704568-651d-4732-b272-79f0b768b96c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:09:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Acquired lock "refresh_cache-a6704568-651d-4732-b272-79f0b768b96c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:09:20 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:09:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-541f123e-92a7-4893-8794-7ad3c4c81e18 req-9a94f5b0-6b5d-44d3-b8b4-7ec763667d9f service nova] [instance: a6704568-651d-4732-b272-79f0b768b96c] Received event network-changed-db77bda8-29ee-428e-809f-3d102d95a9dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-541f123e-92a7-4893-8794-7ad3c4c81e18 req-9a94f5b0-6b5d-44d3-b8b4-7ec763667d9f service nova] [instance: a6704568-651d-4732-b272-79f0b768b96c] Refreshing instance network info cache due to event network-changed-db77bda8-29ee-428e-809f-3d102d95a9dd. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:09:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-541f123e-92a7-4893-8794-7ad3c4c81e18 req-9a94f5b0-6b5d-44d3-b8b4-7ec763667d9f service nova] Acquiring lock "refresh_cache-a6704568-651d-4732-b272-79f0b768b96c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:09:20 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Updating instance_info_cache with network_info: [{"id": "db77bda8-29ee-428e-809f-3d102d95a9dd", "address": "fa:16:3e:74:15:8c", "network": {"id": "824c0402-cd5e-4166-99cf-0a59436847f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bad695133afe4787b2a24160056a5ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb77bda8-29", "ovs_interfaceid": "db77bda8-29ee-428e-809f-3d102d95a9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Releasing lock "refresh_cache-a6704568-651d-4732-b272-79f0b768b96c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Instance network_info: |[{"id": "db77bda8-29ee-428e-809f-3d102d95a9dd", "address": "fa:16:3e:74:15:8c", "network": {"id": "824c0402-cd5e-4166-99cf-0a59436847f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bad695133afe4787b2a24160056a5ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb77bda8-29", "ovs_interfaceid": "db77bda8-29ee-428e-809f-3d102d95a9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-541f123e-92a7-4893-8794-7ad3c4c81e18 req-9a94f5b0-6b5d-44d3-b8b4-7ec763667d9f service nova] Acquired lock "refresh_cache-a6704568-651d-4732-b272-79f0b768b96c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.network.neutron [req-541f123e-92a7-4893-8794-7ad3c4c81e18 req-9a94f5b0-6b5d-44d3-b8b4-7ec763667d9f service nova] [instance: a6704568-651d-4732-b272-79f0b768b96c] Refreshing network info cache for port db77bda8-29ee-428e-809f-3d102d95a9dd {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Start _get_guest_xml network_info=[{"id": "db77bda8-29ee-428e-809f-3d102d95a9dd", "address": "fa:16:3e:74:15:8c", "network": {"id": "824c0402-cd5e-4166-99cf-0a59436847f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bad695133afe4787b2a24160056a5ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb77bda8-29", "ovs_interfaceid": "db77bda8-29ee-428e-809f-3d102d95a9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:09:21 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:09:21 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-959115173',display_name='tempest-VolumesNegativeTest-instance-959115173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-959115173',id=37,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='821f55c16aa848729f8cc373347e5102',ramdisk_id='',reservation_id='r-eqjjstxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-372960210',owner_user_name='tempest-VolumesNegativeTest-372960210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:09:19Z,user_data=None,user_id='b733da53a9b94530a4a85b19e8af1a5c',uuid=a6704568-651d-4732-b272-79f0b768b96c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db77bda8-29ee-428e-809f-3d102d95a9dd", "address": "fa:16:3e:74:15:8c", "network": {"id": "824c0402-cd5e-4166-99cf-0a59436847f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bad695133afe4787b2a24160056a5ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb77bda8-29", "ovs_interfaceid": "db77bda8-29ee-428e-809f-3d102d95a9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Converting VIF {"id": "db77bda8-29ee-428e-809f-3d102d95a9dd", "address": "fa:16:3e:74:15:8c", "network": {"id": "824c0402-cd5e-4166-99cf-0a59436847f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bad695133afe4787b2a24160056a5ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb77bda8-29", "ovs_interfaceid": "db77bda8-29ee-428e-809f-3d102d95a9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:15:8c,bridge_name='br-int',has_traffic_filtering=True,id=db77bda8-29ee-428e-809f-3d102d95a9dd,network=Network(824c0402-cd5e-4166-99cf-0a59436847f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb77bda8-29') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lazy-loading 'pci_devices' on Instance uuid a6704568-651d-4732-b272-79f0b768b96c {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:09:21 user nova-compute[74278]:   <uuid>a6704568-651d-4732-b272-79f0b768b96c</uuid>
Oct 30 11:09:21 user nova-compute[74278]:   <name>instance-00000025</name>
Oct 30 11:09:21 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:09:21 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:09:21 user nova-compute[74278]:   <metadata>
Oct 30 11:09:21 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:09:21 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:09:21 user nova-compute[74278]:       <nova:name>tempest-VolumesNegativeTest-instance-959115173</nova:name>
Oct 30 11:09:21 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:09:21</nova:creationTime>
Oct 30 11:09:21 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:09:21 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:09:21 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:09:21 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:09:21 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:09:21 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:09:21 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:09:21 user nova-compute[74278]:       <nova:owner>
Oct 30 11:09:21 user nova-compute[74278]:         <nova:user uuid="b733da53a9b94530a4a85b19e8af1a5c">tempest-VolumesNegativeTest-372960210-project-member</nova:user>
Oct 30 11:09:21 user nova-compute[74278]:         <nova:project uuid="821f55c16aa848729f8cc373347e5102">tempest-VolumesNegativeTest-372960210</nova:project>
Oct 30 11:09:21 user nova-compute[74278]:       </nova:owner>
Oct 30 11:09:21 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:09:21 user nova-compute[74278]:       <nova:ports>
Oct 30 11:09:21 user nova-compute[74278]:         <nova:port uuid="db77bda8-29ee-428e-809f-3d102d95a9dd">
Oct 30 11:09:21 user nova-compute[74278]:           <nova:ip type="fixed" address="192.168.233.211" ipVersion="4"/>
Oct 30 11:09:21 user nova-compute[74278]:         </nova:port>
Oct 30 11:09:21 user nova-compute[74278]:       </nova:ports>
Oct 30 11:09:21 user nova-compute[74278]:     </nova:instance>
Oct 30 11:09:21 user nova-compute[74278]:   </metadata>
Oct 30 11:09:21 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:09:21 user nova-compute[74278]:     <system>
Oct 30 11:09:21 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:09:21 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:09:21 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:09:21 user nova-compute[74278]:       <entry name="serial">a6704568-651d-4732-b272-79f0b768b96c</entry>
Oct 30 11:09:21 user nova-compute[74278]:       <entry name="uuid">a6704568-651d-4732-b272-79f0b768b96c</entry>
Oct 30 11:09:21 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:09:21 user nova-compute[74278]:     </system>
Oct 30 11:09:21 user nova-compute[74278]:   </sysinfo>
Oct 30 11:09:21 user nova-compute[74278]:   <os>
Oct 30 11:09:21 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:09:21 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:09:21 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:09:21 user nova-compute[74278]:   </os>
Oct 30 11:09:21 user nova-compute[74278]:   <features>
Oct 30 11:09:21 user nova-compute[74278]:     <acpi/>
Oct 30 11:09:21 user nova-compute[74278]:     <apic/>
Oct 30 11:09:21 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:09:21 user nova-compute[74278]:   </features>
Oct 30 11:09:21 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:09:21 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:09:21 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:09:21 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:09:21 user nova-compute[74278]:   </clock>
Oct 30 11:09:21 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:09:21 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:09:21 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:09:21 user nova-compute[74278]:   </cpu>
Oct 30 11:09:21 user nova-compute[74278]:   <devices>
Oct 30 11:09:21 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:09:21 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:09:21 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk"/>
Oct 30 11:09:21 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:09:21 user nova-compute[74278]:     </disk>
Oct 30 11:09:21 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:09:21 user nova-compute[74278]:       <mac address="fa:16:3e:74:15:8c"/>
Oct 30 11:09:21 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:09:21 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:09:21 user nova-compute[74278]:       <target dev="tapdb77bda8-29"/>
Oct 30 11:09:21 user nova-compute[74278]:     </interface>
Oct 30 11:09:21 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:09:21 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/console.log" append="off"/>
Oct 30 11:09:21 user nova-compute[74278]:     </serial>
Oct 30 11:09:21 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:09:21 user nova-compute[74278]:     <video>
Oct 30 11:09:21 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:09:21 user nova-compute[74278]:     </video>
Oct 30 11:09:21 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:09:21 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:09:21 user nova-compute[74278]:     </rng>
Oct 30 11:09:21 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:09:21 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:09:21 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:09:21 user nova-compute[74278]:     </memballoon>
Oct 30 11:09:21 user nova-compute[74278]:   </devices>
Oct 30 11:09:21 user nova-compute[74278]: </domain>
Oct 30 11:09:21 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-959115173',display_name='tempest-VolumesNegativeTest-instance-959115173',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-959115173',id=37,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='821f55c16aa848729f8cc373347e5102',ramdisk_id='',reservation_id='r-eqjjstxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-372960210',owner_user_name='tempest-VolumesNegativeTest-372960210-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:09:19Z,user_data=None,user_id='b733da53a9b94530a4a85b19e8af1a5c',uuid=a6704568-651d-4732-b272-79f0b768b96c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db77bda8-29ee-428e-809f-3d102d95a9dd", "address": "fa:16:3e:74:15:8c", "network": {"id": "824c0402-cd5e-4166-99cf-0a59436847f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bad695133afe4787b2a24160056a5ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb77bda8-29", "ovs_interfaceid": "db77bda8-29ee-428e-809f-3d102d95a9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Converting VIF {"id": "db77bda8-29ee-428e-809f-3d102d95a9dd", "address": "fa:16:3e:74:15:8c", "network": {"id": "824c0402-cd5e-4166-99cf-0a59436847f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bad695133afe4787b2a24160056a5ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb77bda8-29", "ovs_interfaceid": "db77bda8-29ee-428e-809f-3d102d95a9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:15:8c,bridge_name='br-int',has_traffic_filtering=True,id=db77bda8-29ee-428e-809f-3d102d95a9dd,network=Network(824c0402-cd5e-4166-99cf-0a59436847f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb77bda8-29') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG os_vif [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:15:8c,bridge_name='br-int',has_traffic_filtering=True,id=db77bda8-29ee-428e-809f-3d102d95a9dd,network=Network(824c0402-cd5e-4166-99cf-0a59436847f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb77bda8-29') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22ad7df9-c7ea-5a3f-ae32-4e09a7efa5b5', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb77bda8-29, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb77bda8-29, col_values=(('qos', UUID('aae141b2-7801-4ef0-946b-089d80bc9475')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb77bda8-29, col_values=(('external_ids', {'iface-id': 'db77bda8-29ee-428e-809f-3d102d95a9dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:15:8c', 'vm-uuid': 'a6704568-651d-4732-b272-79f0b768b96c'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:21 user nova-compute[74278]: INFO os_vif [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:15:8c,bridge_name='br-int',has_traffic_filtering=True,id=db77bda8-29ee-428e-809f-3d102d95a9dd,network=Network(824c0402-cd5e-4166-99cf-0a59436847f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb77bda8-29')
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] No VIF found with MAC fa:16:3e:74:15:8c, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.network.neutron [req-541f123e-92a7-4893-8794-7ad3c4c81e18 req-9a94f5b0-6b5d-44d3-b8b4-7ec763667d9f service nova] [instance: a6704568-651d-4732-b272-79f0b768b96c] Updated VIF entry in instance network info cache for port db77bda8-29ee-428e-809f-3d102d95a9dd. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG nova.network.neutron [req-541f123e-92a7-4893-8794-7ad3c4c81e18 req-9a94f5b0-6b5d-44d3-b8b4-7ec763667d9f service nova] [instance: a6704568-651d-4732-b272-79f0b768b96c] Updating instance_info_cache with network_info: [{"id": "db77bda8-29ee-428e-809f-3d102d95a9dd", "address": "fa:16:3e:74:15:8c", "network": {"id": "824c0402-cd5e-4166-99cf-0a59436847f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bad695133afe4787b2a24160056a5ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb77bda8-29", "ovs_interfaceid": "db77bda8-29ee-428e-809f-3d102d95a9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:09:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-541f123e-92a7-4893-8794-7ad3c4c81e18 req-9a94f5b0-6b5d-44d3-b8b4-7ec763667d9f service nova] Releasing lock "refresh_cache-a6704568-651d-4732-b272-79f0b768b96c" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:09:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-788aa0de-5081-4a90-9bd8-48e5bdf830ce req-5f484b41-c985-4fa2-850a-4700ce4d5bb5 service nova] [instance: a6704568-651d-4732-b272-79f0b768b96c] Received event network-vif-plugged-db77bda8-29ee-428e-809f-3d102d95a9dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-788aa0de-5081-4a90-9bd8-48e5bdf830ce req-5f484b41-c985-4fa2-850a-4700ce4d5bb5 service nova] Acquiring lock "a6704568-651d-4732-b272-79f0b768b96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-788aa0de-5081-4a90-9bd8-48e5bdf830ce req-5f484b41-c985-4fa2-850a-4700ce4d5bb5 service nova] Lock "a6704568-651d-4732-b272-79f0b768b96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-788aa0de-5081-4a90-9bd8-48e5bdf830ce req-5f484b41-c985-4fa2-850a-4700ce4d5bb5 service nova] Lock "a6704568-651d-4732-b272-79f0b768b96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-788aa0de-5081-4a90-9bd8-48e5bdf830ce req-5f484b41-c985-4fa2-850a-4700ce4d5bb5 service nova] [instance: a6704568-651d-4732-b272-79f0b768b96c] No waiting events found dispatching network-vif-plugged-db77bda8-29ee-428e-809f-3d102d95a9dd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:09:22 user nova-compute[74278]: WARNING nova.compute.manager [req-788aa0de-5081-4a90-9bd8-48e5bdf830ce req-5f484b41-c985-4fa2-850a-4700ce4d5bb5 service nova] [instance: a6704568-651d-4732-b272-79f0b768b96c] Received unexpected event network-vif-plugged-db77bda8-29ee-428e-809f-3d102d95a9dd for instance with vm_state building and task_state spawning.
Oct 30 11:09:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:09:24 user nova-compute[74278]: INFO nova.compute.claims [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Claim successful on node user
Oct 30 11:09:24 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:09:24 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:09:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG nova.policy [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b9a38bd9c4e4717b9499ed404ed2d6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8215346d10443799d5d450114b09386', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:09:24 user nova-compute[74278]: INFO nova.virt.block_device [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Booting with volume 32a94a98-5e5d-4bde-89ad-576a82f2060f at /dev/vda
Oct 30 11:09:24 user nova-compute[74278]: DEBUG os_brick.utils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1eea60-5176-4c60-96c8-6a73cd52b405]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c948764e-e3e8-40c6-ac67-55630dd4b737]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb64787d-b55a-42f1-8fb5-2cf935da0915]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[336be232-a471-40ad-ac82-aebcf1c2bfcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:09:24 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeb0c07-c608-4914-bac6-14ed6e880f8a]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG os_brick.utils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating existing volume attachment record: bf962648-23d0-4b30-8da9-e5f7c6a91baa {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG nova.compute.manager [req-f52a3fc2-4ce9-4288-8afe-708dc02e22a4 req-609d8460-88cb-4640-a2c1-ab9926808806 service nova] [instance: a6704568-651d-4732-b272-79f0b768b96c] Received event network-vif-plugged-db77bda8-29ee-428e-809f-3d102d95a9dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f52a3fc2-4ce9-4288-8afe-708dc02e22a4 req-609d8460-88cb-4640-a2c1-ab9926808806 service nova] Acquiring lock "a6704568-651d-4732-b272-79f0b768b96c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f52a3fc2-4ce9-4288-8afe-708dc02e22a4 req-609d8460-88cb-4640-a2c1-ab9926808806 service nova] Lock "a6704568-651d-4732-b272-79f0b768b96c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f52a3fc2-4ce9-4288-8afe-708dc02e22a4 req-609d8460-88cb-4640-a2c1-ab9926808806 service nova] Lock "a6704568-651d-4732-b272-79f0b768b96c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:24 user nova-compute[74278]: DEBUG nova.compute.manager [req-f52a3fc2-4ce9-4288-8afe-708dc02e22a4 req-609d8460-88cb-4640-a2c1-ab9926808806 service nova] [instance: a6704568-651d-4732-b272-79f0b768b96c] No waiting events found dispatching network-vif-plugged-db77bda8-29ee-428e-809f-3d102d95a9dd {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:09:24 user nova-compute[74278]: WARNING nova.compute.manager [req-f52a3fc2-4ce9-4288-8afe-708dc02e22a4 req-609d8460-88cb-4640-a2c1-ab9926808806 service nova] [instance: a6704568-651d-4732-b272-79f0b768b96c] Received unexpected event network-vif-plugged-db77bda8-29ee-428e-809f-3d102d95a9dd for instance with vm_state building and task_state spawning.
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:09:25 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a6704568-651d-4732-b272-79f0b768b96c] Instance spawned successfully.
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:25 user nova-compute[74278]: INFO nova.compute.manager [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Took 6.27 seconds to spawn the instance on the hypervisor.
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:09:25 user nova-compute[74278]: INFO nova.compute.manager [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Took 7.02 seconds to build instance.
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Successfully created port: 8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8ffd7fe7-06f3-4f96-9751-7c0e01b727ee tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "a6704568-651d-4732-b272-79f0b768b96c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.135s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:25 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:09:25 user nova-compute[74278]: INFO nova.compute.claims [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Claim successful on node user
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Successfully updated port: 8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquired lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:26 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-07640c37-980f-44db-8145-783cce4fa766 req-4a8da2b4-8ccd-456f-a9fe-17e259cd8a63 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received event network-changed-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-07640c37-980f-44db-8145-783cce4fa766 req-4a8da2b4-8ccd-456f-a9fe-17e259cd8a63 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Refreshing instance network info cache due to event network-changed-8de72719-56c4-4be2-b3f6-f4207ae8f395. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-07640c37-980f-44db-8145-783cce4fa766 req-4a8da2b4-8ccd-456f-a9fe-17e259cd8a63 service nova] Acquiring lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.policy [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffaf2383261d4cc1a6d7b304f515914b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ee9b3a0343474183d1e12dcef41703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:09:26 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Creating image(s)
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "/opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "/opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "/opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.304s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.network.neutron [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating instance_info_cache with network_info: [{"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Releasing lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Instance network_info: |[{"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-07640c37-980f-44db-8145-783cce4fa766 req-4a8da2b4-8ccd-456f-a9fe-17e259cd8a63 service nova] Acquired lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:09:26 user nova-compute[74278]: DEBUG nova.network.neutron [req-07640c37-980f-44db-8145-783cce4fa766 req-4a8da2b4-8ccd-456f-a9fe-17e259cd8a63 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Refreshing network info cache for port 8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.321s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk 1073741824" returned: 0 in 0.075s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.402s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Successfully created port: 63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.220s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Checking if we can resize image /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Cannot resize image /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Ensure instance console log exists: /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG nova.network.neutron [req-07640c37-980f-44db-8145-783cce4fa766 req-4a8da2b4-8ccd-456f-a9fe-17e259cd8a63 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updated VIF entry in instance network info cache for port 8de72719-56c4-4be2-b3f6-f4207ae8f395. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG nova.network.neutron [req-07640c37-980f-44db-8145-783cce4fa766 req-4a8da2b4-8ccd-456f-a9fe-17e259cd8a63 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating instance_info_cache with network_info: [{"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:09:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-07640c37-980f-44db-8145-783cce4fa766 req-4a8da2b4-8ccd-456f-a9fe-17e259cd8a63 service nova] Releasing lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Successfully updated port: 63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "refresh_cache-453b1f71-8dc2-4f91-923a-dd183f2ec3ea" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquired lock "refresh_cache-453b1f71-8dc2-4f91-923a-dd183f2ec3ea" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-7b4f227c-da04-41d7-9a76-8b90f8bdf0bd req-3b3f4527-dbe3-4d20-9b15-0cff4d826a21 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Received event network-changed-63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-7b4f227c-da04-41d7-9a76-8b90f8bdf0bd req-3b3f4527-dbe3-4d20-9b15-0cff4d826a21 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Refreshing instance network info cache due to event network-changed-63cb19f9-b71e-4400-9c40-e1108880fb85. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7b4f227c-da04-41d7-9a76-8b90f8bdf0bd req-3b3f4527-dbe3-4d20-9b15-0cff4d826a21 service nova] Acquiring lock "refresh_cache-453b1f71-8dc2-4f91-923a-dd183f2ec3ea" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Updating instance_info_cache with network_info: [{"id": "63cb19f9-b71e-4400-9c40-e1108880fb85", "address": "fa:16:3e:36:67:d4", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63cb19f9-b7", "ovs_interfaceid": "63cb19f9-b71e-4400-9c40-e1108880fb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Releasing lock "refresh_cache-453b1f71-8dc2-4f91-923a-dd183f2ec3ea" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Instance network_info: |[{"id": "63cb19f9-b71e-4400-9c40-e1108880fb85", "address": "fa:16:3e:36:67:d4", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63cb19f9-b7", "ovs_interfaceid": "63cb19f9-b71e-4400-9c40-e1108880fb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7b4f227c-da04-41d7-9a76-8b90f8bdf0bd req-3b3f4527-dbe3-4d20-9b15-0cff4d826a21 service nova] Acquired lock "refresh_cache-453b1f71-8dc2-4f91-923a-dd183f2ec3ea" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.network.neutron [req-7b4f227c-da04-41d7-9a76-8b90f8bdf0bd req-3b3f4527-dbe3-4d20-9b15-0cff4d826a21 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Refreshing network info cache for port 63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Start _get_guest_xml network_info=[{"id": "63cb19f9-b71e-4400-9c40-e1108880fb85", "address": "fa:16:3e:36:67:d4", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63cb19f9-b7", "ovs_interfaceid": "63cb19f9-b71e-4400-9c40-e1108880fb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:09:28 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:09:28 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1256415203',display_name='tempest-VolumesSnapshotTestJSON-instance-1256415203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1256415203',id=39,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJVwC/7MaUsvA47JXf5/RW1Oa9q8gzWIlYzlDZyU3pHPcw8vCFkTLCZzR8ViGCRQHSLJ3xeoQc2hXnJylwus1qPb6wqT9VbdjwSet9R+rDdaM5SclsCEPmGi5XaFaITVg==',key_name='tempest-keypair-58501289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59ee9b3a0343474183d1e12dcef41703',ramdisk_id='',reservation_id='r-gj08lp54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-24712219',owner_user_name='tempest-VolumesSnapshotTestJSON-24712219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffaf2383261d4cc1a6d7b304f515914b',uuid=453b1f71-8dc2-4f91-923a-dd183f2ec3ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63cb19f9-b71e-4400-9c40-e1108880fb85", "address": "fa:16:3e:36:67:d4", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63cb19f9-b7", "ovs_interfaceid": "63cb19f9-b71e-4400-9c40-e1108880fb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Converting VIF {"id": "63cb19f9-b71e-4400-9c40-e1108880fb85", "address": "fa:16:3e:36:67:d4", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63cb19f9-b7", "ovs_interfaceid": "63cb19f9-b71e-4400-9c40-e1108880fb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:67:d4,bridge_name='br-int',has_traffic_filtering=True,id=63cb19f9-b71e-4400-9c40-e1108880fb85,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63cb19f9-b7') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.objects.instance [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lazy-loading 'pci_devices' on Instance uuid 453b1f71-8dc2-4f91-923a-dd183f2ec3ea {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:09:28 user nova-compute[74278]:   <uuid>453b1f71-8dc2-4f91-923a-dd183f2ec3ea</uuid>
Oct 30 11:09:28 user nova-compute[74278]:   <name>instance-00000027</name>
Oct 30 11:09:28 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:09:28 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:09:28 user nova-compute[74278]:   <metadata>
Oct 30 11:09:28 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:09:28 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:09:28 user nova-compute[74278]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1256415203</nova:name>
Oct 30 11:09:28 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:09:28</nova:creationTime>
Oct 30 11:09:28 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:09:28 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:09:28 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:09:28 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:09:28 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:09:28 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:09:28 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:09:28 user nova-compute[74278]:       <nova:owner>
Oct 30 11:09:28 user nova-compute[74278]:         <nova:user uuid="ffaf2383261d4cc1a6d7b304f515914b">tempest-VolumesSnapshotTestJSON-24712219-project-member</nova:user>
Oct 30 11:09:28 user nova-compute[74278]:         <nova:project uuid="59ee9b3a0343474183d1e12dcef41703">tempest-VolumesSnapshotTestJSON-24712219</nova:project>
Oct 30 11:09:28 user nova-compute[74278]:       </nova:owner>
Oct 30 11:09:28 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:09:28 user nova-compute[74278]:       <nova:ports>
Oct 30 11:09:28 user nova-compute[74278]:         <nova:port uuid="63cb19f9-b71e-4400-9c40-e1108880fb85">
Oct 30 11:09:28 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 11:09:28 user nova-compute[74278]:         </nova:port>
Oct 30 11:09:28 user nova-compute[74278]:       </nova:ports>
Oct 30 11:09:28 user nova-compute[74278]:     </nova:instance>
Oct 30 11:09:28 user nova-compute[74278]:   </metadata>
Oct 30 11:09:28 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:09:28 user nova-compute[74278]:     <system>
Oct 30 11:09:28 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:09:28 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:09:28 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:09:28 user nova-compute[74278]:       <entry name="serial">453b1f71-8dc2-4f91-923a-dd183f2ec3ea</entry>
Oct 30 11:09:28 user nova-compute[74278]:       <entry name="uuid">453b1f71-8dc2-4f91-923a-dd183f2ec3ea</entry>
Oct 30 11:09:28 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:09:28 user nova-compute[74278]:     </system>
Oct 30 11:09:28 user nova-compute[74278]:   </sysinfo>
Oct 30 11:09:28 user nova-compute[74278]:   <os>
Oct 30 11:09:28 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:09:28 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:09:28 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:09:28 user nova-compute[74278]:   </os>
Oct 30 11:09:28 user nova-compute[74278]:   <features>
Oct 30 11:09:28 user nova-compute[74278]:     <acpi/>
Oct 30 11:09:28 user nova-compute[74278]:     <apic/>
Oct 30 11:09:28 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:09:28 user nova-compute[74278]:   </features>
Oct 30 11:09:28 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:09:28 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:09:28 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:09:28 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:09:28 user nova-compute[74278]:   </clock>
Oct 30 11:09:28 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:09:28 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:09:28 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:09:28 user nova-compute[74278]:   </cpu>
Oct 30 11:09:28 user nova-compute[74278]:   <devices>
Oct 30 11:09:28 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:09:28 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:09:28 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk"/>
Oct 30 11:09:28 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:09:28 user nova-compute[74278]:     </disk>
Oct 30 11:09:28 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:09:28 user nova-compute[74278]:       <mac address="fa:16:3e:36:67:d4"/>
Oct 30 11:09:28 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:09:28 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:09:28 user nova-compute[74278]:       <target dev="tap63cb19f9-b7"/>
Oct 30 11:09:28 user nova-compute[74278]:     </interface>
Oct 30 11:09:28 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:09:28 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/console.log" append="off"/>
Oct 30 11:09:28 user nova-compute[74278]:     </serial>
Oct 30 11:09:28 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:09:28 user nova-compute[74278]:     <video>
Oct 30 11:09:28 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:09:28 user nova-compute[74278]:     </video>
Oct 30 11:09:28 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:09:28 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:09:28 user nova-compute[74278]:     </rng>
Oct 30 11:09:28 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:09:28 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:09:28 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:09:28 user nova-compute[74278]:     </memballoon>
Oct 30 11:09:28 user nova-compute[74278]:   </devices>
Oct 30 11:09:28 user nova-compute[74278]: </domain>
Oct 30 11:09:28 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1256415203',display_name='tempest-VolumesSnapshotTestJSON-instance-1256415203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1256415203',id=39,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJVwC/7MaUsvA47JXf5/RW1Oa9q8gzWIlYzlDZyU3pHPcw8vCFkTLCZzR8ViGCRQHSLJ3xeoQc2hXnJylwus1qPb6wqT9VbdjwSet9R+rDdaM5SclsCEPmGi5XaFaITVg==',key_name='tempest-keypair-58501289',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59ee9b3a0343474183d1e12dcef41703',ramdisk_id='',reservation_id='r-gj08lp54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-24712219',owner_user_name='tempest-VolumesSnapshotTestJSON-24712219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:09:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffaf2383261d4cc1a6d7b304f515914b',uuid=453b1f71-8dc2-4f91-923a-dd183f2ec3ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63cb19f9-b71e-4400-9c40-e1108880fb85", "address": "fa:16:3e:36:67:d4", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63cb19f9-b7", "ovs_interfaceid": "63cb19f9-b71e-4400-9c40-e1108880fb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Converting VIF {"id": "63cb19f9-b71e-4400-9c40-e1108880fb85", "address": "fa:16:3e:36:67:d4", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63cb19f9-b7", "ovs_interfaceid": "63cb19f9-b71e-4400-9c40-e1108880fb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:67:d4,bridge_name='br-int',has_traffic_filtering=True,id=63cb19f9-b71e-4400-9c40-e1108880fb85,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63cb19f9-b7') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG os_vif [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:67:d4,bridge_name='br-int',has_traffic_filtering=True,id=63cb19f9-b71e-4400-9c40-e1108880fb85,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63cb19f9-b7') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e29e67f-ac64-5abc-9863-1aa9d806b25b', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63cb19f9-b7, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63cb19f9-b7, col_values=(('qos', UUID('64019b8b-bb4e-4a84-b577-e65d18377b33')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63cb19f9-b7, col_values=(('external_ids', {'iface-id': '63cb19f9-b71e-4400-9c40-e1108880fb85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:67:d4', 'vm-uuid': '453b1f71-8dc2-4f91-923a-dd183f2ec3ea'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:28 user nova-compute[74278]: INFO os_vif [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:67:d4,bridge_name='br-int',has_traffic_filtering=True,id=63cb19f9-b71e-4400-9c40-e1108880fb85,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63cb19f9-b7')
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:09:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] No VIF found with MAC fa:16:3e:36:67:d4, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:09:29 user nova-compute[74278]: DEBUG nova.network.neutron [req-7b4f227c-da04-41d7-9a76-8b90f8bdf0bd req-3b3f4527-dbe3-4d20-9b15-0cff4d826a21 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Updated VIF entry in instance network info cache for port 63cb19f9-b71e-4400-9c40-e1108880fb85. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:09:29 user nova-compute[74278]: DEBUG nova.network.neutron [req-7b4f227c-da04-41d7-9a76-8b90f8bdf0bd req-3b3f4527-dbe3-4d20-9b15-0cff4d826a21 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Updating instance_info_cache with network_info: [{"id": "63cb19f9-b71e-4400-9c40-e1108880fb85", "address": "fa:16:3e:36:67:d4", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63cb19f9-b7", "ovs_interfaceid": "63cb19f9-b71e-4400-9c40-e1108880fb85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:09:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7b4f227c-da04-41d7-9a76-8b90f8bdf0bd req-3b3f4527-dbe3-4d20-9b15-0cff4d826a21 service nova] Releasing lock "refresh_cache-453b1f71-8dc2-4f91-923a-dd183f2ec3ea" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:09:29 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:09:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-33e09e57-ceec-4653-be11-0b3715060a6b req-d4cd49b7-19e6-4752-bdfc-0b0e33e33dd6 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Received event network-vif-plugged-63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-33e09e57-ceec-4653-be11-0b3715060a6b req-d4cd49b7-19e6-4752-bdfc-0b0e33e33dd6 service nova] Acquiring lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-33e09e57-ceec-4653-be11-0b3715060a6b req-d4cd49b7-19e6-4752-bdfc-0b0e33e33dd6 service nova] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-33e09e57-ceec-4653-be11-0b3715060a6b req-d4cd49b7-19e6-4752-bdfc-0b0e33e33dd6 service nova] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-33e09e57-ceec-4653-be11-0b3715060a6b req-d4cd49b7-19e6-4752-bdfc-0b0e33e33dd6 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] No waiting events found dispatching network-vif-plugged-63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:09:30 user nova-compute[74278]: WARNING nova.compute.manager [req-33e09e57-ceec-4653-be11-0b3715060a6b req-d4cd49b7-19e6-4752-bdfc-0b0e33e33dd6 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Received unexpected event network-vif-plugged-63cb19f9-b71e-4400-9c40-e1108880fb85 for instance with vm_state building and task_state spawning.
Oct 30 11:09:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.compute.manager [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:09:32 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Creating image(s)
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Ensure instance console log exists: /opt/stack/data/nova/instances/0274d8c3-6a83-4959-85a6-4b8168a43df0/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Start _get_guest_xml network_info=[{"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdTxZNec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0274d8c3-6a83-4959-85a6-4b8168a43df0', 'attached_at': '', 'detached_at': '', 'volume_id': '9326cea9-3b72-4121-94cc-f2e6246f1108', 'serial': '9326cea9-3b72-4121-94cc-f2e6246f1108'}, 'attachment_id': '075aa324-89fc-4bc5-9895-2214d9939319', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:09:32 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:09:32 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdTxZNec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:09:32 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:09:32 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:09:32 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96e7458-dfd9-46e6-b81b-eaf069a15ced]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:09:32 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef8b27a-c2d6-413b-a75d-8ee724491129]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108] added
Oct 30 11:09:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[634dfdd0-bef9-4960-b834-b13a34e64bd7]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[160909f6-8580-4125-98d3-8acdf7530824]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdTxZNec {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdTxZNec" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[489a224b-56d9-4fa7-b8a9-8db12f9dfbef]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bdTxZNec'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5901eb77-1169-4db6-85ac-d691fc2a58de]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deb4b06-2349-4fb5-8610-71103b9acb07]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:09:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:09:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb47e9ee-cbc6-4eef-94dd-20170eb17064]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260]
Oct 30 11:09:32 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260] successful.
Oct 30 11:09:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b381f1-aa1f-4bb0-8f30-8b038bc35c6c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb8fa71-1807-4425-918a-4a8035889ea7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:09:32 user nova-compute[74278]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:09:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:09:32 user nova-compute[74278]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:09:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8a3c95-bb2a-42d4-a5c0-7f6bd0d00e64]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.compute.manager [req-accf98fc-f383-450d-b804-1e76f42e9e24 req-4a43883b-7845-4b86-97c4-f86bdbfaeb96 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Received event network-vif-plugged-63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-accf98fc-f383-450d-b804-1e76f42e9e24 req-4a43883b-7845-4b86-97c4-f86bdbfaeb96 service nova] Acquiring lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-accf98fc-f383-450d-b804-1e76f42e9e24 req-4a43883b-7845-4b86-97c4-f86bdbfaeb96 service nova] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-accf98fc-f383-450d-b804-1e76f42e9e24 req-4a43883b-7845-4b86-97c4-f86bdbfaeb96 service nova] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.compute.manager [req-accf98fc-f383-450d-b804-1e76f42e9e24 req-4a43883b-7845-4b86-97c4-f86bdbfaeb96 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] No waiting events found dispatching network-vif-plugged-63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:09:32 user nova-compute[74278]: WARNING nova.compute.manager [req-accf98fc-f383-450d-b804-1e76f42e9e24 req-4a43883b-7845-4b86-97c4-f86bdbfaeb96 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Received unexpected event network-vif-plugged-63cb19f9-b71e-4400-9c40-e1108880fb85 for instance with vm_state building and task_state spawning.
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:09:32 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Instance spawned successfully.
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:32 user nova-compute[74278]: INFO nova.compute.manager [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Took 6.55 seconds to spawn the instance on the hypervisor.
Oct 30 11:09:32 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:09:33 user nova-compute[74278]: INFO nova.compute.manager [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Took 7.56 seconds to build instance.
Oct 30 11:09:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4ef77037-1306-4d4f-ae5a-c138a08afcbc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.668s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdTxZNec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26263373635346237', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263373635346237', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1141748642',display_name='tempest-TestShelveInstance-server-1141748642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1141748642',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjajcqPMAHLG5BDRh8OD9ZGA5CKTelBhRuT/G7iIHJd8dsF5nAIa7BHI3I4Fbbc5SqqA/eYbWHvIRDp5Is/LZBwmEgeiE8F2co+QnBDTqzi8c7WBLfkmSY+V8sZ+/nj0g==',key_name='tempest-TestShelveInstance-1615884152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af9e783ec7f44a65b46dac4e2c11e5b1',ramdisk_id='',reservation_id='r-e80lsc1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1856925634',owner_user_name='tempest-TestShelveInstance-1856925634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:09:09Z,user_data=None,user_id='6b92838c59a9488bb72de434b984abf7',uuid=0274d8c3-6a83-4959-85a6-4b8168a43df0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Converting VIF {"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG nova.objects.instance [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lazy-loading 'pci_devices' on Instance uuid 0274d8c3-6a83-4959-85a6-4b8168a43df0 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:09:33 user nova-compute[74278]:   <uuid>0274d8c3-6a83-4959-85a6-4b8168a43df0</uuid>
Oct 30 11:09:33 user nova-compute[74278]:   <name>instance-00000024</name>
Oct 30 11:09:33 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:09:33 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:09:33 user nova-compute[74278]:   <metadata>
Oct 30 11:09:33 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:09:33 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:09:33 user nova-compute[74278]:       <nova:name>tempest-TestShelveInstance-server-1141748642</nova:name>
Oct 30 11:09:33 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:09:32</nova:creationTime>
Oct 30 11:09:33 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:09:33 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:09:33 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:09:33 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:09:33 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:09:33 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:09:33 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:09:33 user nova-compute[74278]:       <nova:owner>
Oct 30 11:09:33 user nova-compute[74278]:         <nova:user uuid="6b92838c59a9488bb72de434b984abf7">tempest-TestShelveInstance-1856925634-project-member</nova:user>
Oct 30 11:09:33 user nova-compute[74278]:         <nova:project uuid="af9e783ec7f44a65b46dac4e2c11e5b1">tempest-TestShelveInstance-1856925634</nova:project>
Oct 30 11:09:33 user nova-compute[74278]:       </nova:owner>
Oct 30 11:09:33 user nova-compute[74278]:       <nova:ports>
Oct 30 11:09:33 user nova-compute[74278]:         <nova:port uuid="1491bcc7-6199-4857-a8b0-ad1efc591df5">
Oct 30 11:09:33 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 11:09:33 user nova-compute[74278]:         </nova:port>
Oct 30 11:09:33 user nova-compute[74278]:       </nova:ports>
Oct 30 11:09:33 user nova-compute[74278]:     </nova:instance>
Oct 30 11:09:33 user nova-compute[74278]:   </metadata>
Oct 30 11:09:33 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:09:33 user nova-compute[74278]:     <system>
Oct 30 11:09:33 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:09:33 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:09:33 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:09:33 user nova-compute[74278]:       <entry name="serial">0274d8c3-6a83-4959-85a6-4b8168a43df0</entry>
Oct 30 11:09:33 user nova-compute[74278]:       <entry name="uuid">0274d8c3-6a83-4959-85a6-4b8168a43df0</entry>
Oct 30 11:09:33 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:09:33 user nova-compute[74278]:     </system>
Oct 30 11:09:33 user nova-compute[74278]:   </sysinfo>
Oct 30 11:09:33 user nova-compute[74278]:   <os>
Oct 30 11:09:33 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:09:33 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:09:33 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:09:33 user nova-compute[74278]:   </os>
Oct 30 11:09:33 user nova-compute[74278]:   <features>
Oct 30 11:09:33 user nova-compute[74278]:     <acpi/>
Oct 30 11:09:33 user nova-compute[74278]:     <apic/>
Oct 30 11:09:33 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:09:33 user nova-compute[74278]:   </features>
Oct 30 11:09:33 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:09:33 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:09:33 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:09:33 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:09:33 user nova-compute[74278]:   </clock>
Oct 30 11:09:33 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:09:33 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:09:33 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:09:33 user nova-compute[74278]:   </cpu>
Oct 30 11:09:33 user nova-compute[74278]:   <devices>
Oct 30 11:09:33 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:09:33 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:09:33 user nova-compute[74278]:       <source dev="/dev/sdb"/>
Oct 30 11:09:33 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:09:33 user nova-compute[74278]:       <serial>9326cea9-3b72-4121-94cc-f2e6246f1108</serial>
Oct 30 11:09:33 user nova-compute[74278]:     </disk>
Oct 30 11:09:33 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:09:33 user nova-compute[74278]:       <mac address="fa:16:3e:ca:8e:78"/>
Oct 30 11:09:33 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:09:33 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:09:33 user nova-compute[74278]:       <target dev="tap1491bcc7-61"/>
Oct 30 11:09:33 user nova-compute[74278]:     </interface>
Oct 30 11:09:33 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:09:33 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/0274d8c3-6a83-4959-85a6-4b8168a43df0/console.log" append="off"/>
Oct 30 11:09:33 user nova-compute[74278]:     </serial>
Oct 30 11:09:33 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:09:33 user nova-compute[74278]:     <video>
Oct 30 11:09:33 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:09:33 user nova-compute[74278]:     </video>
Oct 30 11:09:33 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:09:33 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:09:33 user nova-compute[74278]:     </rng>
Oct 30 11:09:33 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:09:33 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:09:33 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:09:33 user nova-compute[74278]:     </memballoon>
Oct 30 11:09:33 user nova-compute[74278]:   </devices>
Oct 30 11:09:33 user nova-compute[74278]: </domain>
Oct 30 11:09:33 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1141748642',display_name='tempest-TestShelveInstance-server-1141748642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1141748642',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjajcqPMAHLG5BDRh8OD9ZGA5CKTelBhRuT/G7iIHJd8dsF5nAIa7BHI3I4Fbbc5SqqA/eYbWHvIRDp5Is/LZBwmEgeiE8F2co+QnBDTqzi8c7WBLfkmSY+V8sZ+/nj0g==',key_name='tempest-TestShelveInstance-1615884152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='af9e783ec7f44a65b46dac4e2c11e5b1',ramdisk_id='',reservation_id='r-e80lsc1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1856925634',owner_user_name='tempest-TestShelveInstance-1856925634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:09:09Z,user_data=None,user_id='6b92838c59a9488bb72de434b984abf7',uuid=0274d8c3-6a83-4959-85a6-4b8168a43df0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Converting VIF {"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG os_vif [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83d1c635-566e-56e9-aebd-cdf69924daad', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1491bcc7-61, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1491bcc7-61, col_values=(('qos', UUID('372e4f85-6387-4744-a94a-99e09eaf9ddd')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1491bcc7-61, col_values=(('external_ids', {'iface-id': '1491bcc7-6199-4857-a8b0-ad1efc591df5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:8e:78', 'vm-uuid': '0274d8c3-6a83-4959-85a6-4b8168a43df0'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:33 user nova-compute[74278]: INFO os_vif [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61')
Oct 30 11:09:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:09:33 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] No VIF found with MAC fa:16:3e:ca:8e:78, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:09:34 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:09:34 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:09:34 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Didn't find any instances for network info cache update. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 11:09:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:35 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:09:35 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:09:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-078961df-40db-4042-a5c8-0fb07fea7790 req-7bbd3cd0-87d4-4b0c-b655-8749e0b45514 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-078961df-40db-4042-a5c8-0fb07fea7790 req-7bbd3cd0-87d4-4b0c-b655-8749e0b45514 service nova] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-078961df-40db-4042-a5c8-0fb07fea7790 req-7bbd3cd0-87d4-4b0c-b655-8749e0b45514 service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-078961df-40db-4042-a5c8-0fb07fea7790 req-7bbd3cd0-87d4-4b0c-b655-8749e0b45514 service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:35 user nova-compute[74278]: DEBUG nova.compute.manager [req-078961df-40db-4042-a5c8-0fb07fea7790 req-7bbd3cd0-87d4-4b0c-b655-8749e0b45514 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] No waiting events found dispatching network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:09:35 user nova-compute[74278]: WARNING nova.compute.manager [req-078961df-40db-4042-a5c8-0fb07fea7790 req-7bbd3cd0-87d4-4b0c-b655-8749e0b45514 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received unexpected event network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 for instance with vm_state building and task_state spawning.
Oct 30 11:09:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG nova.compute.manager [req-5ede3f70-79ad-41ca-b6ce-0849a525554d req-c28fd200-1f53-4825-8c9b-2608e8f0815b service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5ede3f70-79ad-41ca-b6ce-0849a525554d req-c28fd200-1f53-4825-8c9b-2608e8f0815b service nova] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5ede3f70-79ad-41ca-b6ce-0849a525554d req-c28fd200-1f53-4825-8c9b-2608e8f0815b service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5ede3f70-79ad-41ca-b6ce-0849a525554d req-c28fd200-1f53-4825-8c9b-2608e8f0815b service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG nova.compute.manager [req-5ede3f70-79ad-41ca-b6ce-0849a525554d req-c28fd200-1f53-4825-8c9b-2608e8f0815b service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] No waiting events found dispatching network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:09:37 user nova-compute[74278]: WARNING nova.compute.manager [req-5ede3f70-79ad-41ca-b6ce-0849a525554d req-c28fd200-1f53-4825-8c9b-2608e8f0815b service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received unexpected event network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 for instance with vm_state building and task_state spawning.
Oct 30 11:09:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:09:37 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Instance spawned successfully.
Oct 30 11:09:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:38 user nova-compute[74278]: INFO nova.compute.manager [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Took 5.75 seconds to spawn the instance on the hypervisor.
Oct 30 11:09:38 user nova-compute[74278]: DEBUG nova.compute.manager [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:09:38 user nova-compute[74278]: INFO nova.compute.manager [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Took 29.85 seconds to build instance.
Oct 30 11:09:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-746479d4-c28e-4d2f-b632-c865f003cdb7 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.962s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:38 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:09:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:38 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:09:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:38 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:39 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:09:41 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:09:41 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7976MB free_disk=24.956016540527344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2591f731-03b7-49b6-93af-c5b63e505127 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 290c5792-7212-4a44-bf02-b51133a118ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0274d8c3-6a83-4959-85a6-4b8168a43df0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a6704568-651d-4732-b272-79f0b768b96c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a2cde4ee-e665-457a-b5f0-652a2c2b7f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 453b1f71-8dc2-4f91-923a-dd183f2ec3ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:09:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:09:42 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:09:42 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:09:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:09:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:45 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:09:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:09:48 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Creating image(s)
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Ensure instance console log exists: /opt/stack/data/nova/instances/a2cde4ee-e665-457a-b5f0-652a2c2b7f49/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Start _get_guest_xml network_info=[{"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXBJdloE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a2cde4ee-e665-457a-b5f0-652a2c2b7f49', 'attached_at': '', 'detached_at': '', 'volume_id': '32a94a98-5e5d-4bde-89ad-576a82f2060f', 'serial': '32a94a98-5e5d-4bde-89ad-576a82f2060f'}, 'attachment_id': 'bf962648-23d0-4b30-8da9-e5f7c6a91baa', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:09:48 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:09:48 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXBJdloE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:09:48 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:09:48 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:09:48 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b7c11e-8cb5-4e7e-9cf6-332066e0897c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:09:48 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca2b140-76f7-45cc-82e3-27146e05c10d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f] added
Oct 30 11:09:48 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6281ec3e-e5b1-4f3f-8946-e08d7e0adef3]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff43d0a2-b6a9-4022-b497-a16e62d59f05]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXBJdloE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXBJdloE" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8dbb50-e2cb-4081-8ece-cc6495ac7c12]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GXBJdloE'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[829bd242-311a-4852-b012-5dd27df1af85]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c41401-0e02-4cb5-83d5-3a710ff86c05]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:09:48 user nova-compute[74278]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:09:48 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:09:48 user nova-compute[74278]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:09:48 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de9d246-2eb8-4b61-bfbf-4b502f4b56d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260]
Oct 30 11:09:48 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260] successful.
Oct 30 11:09:48 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac430854-57e3-49b3-97b1-c4c53e254d1b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b4c4e0-6994-4aa6-95d2-53f099b8f9d1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:09:48 user nova-compute[74278]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:09:48 user nova-compute[74278]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:09:48 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:09:48 user nova-compute[74278]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:09:48 user nova-compute[74278]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:09:48 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb541a9-a8b8-4bb4-b0f7-636ede2f110a]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXBJdloE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:09:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26563356137363236', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563356137363236', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-238911529',display_name='tempest-ServerActionsTestOtherA-server-238911529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-238911529',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+yfE1fzC0NeFR+gspIaPJ/CcDdqYlrTD1/gMueYz50h0LQsw5TCBiSQS0P2divdfLo9Fj2hNvf4LMgeazslsUbDPOdzcoch9KTxV2Qpnb5QJ+Ahxn1Nm/kcqA+i5KG3A==',key_name='tempest-keypair-148099064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-zwruvzc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=a2cde4ee-e665-457a-b5f0-652a2c2b7f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG nova.objects.instance [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lazy-loading 'pci_devices' on Instance uuid a2cde4ee-e665-457a-b5f0-652a2c2b7f49 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:09:49 user nova-compute[74278]:   <uuid>a2cde4ee-e665-457a-b5f0-652a2c2b7f49</uuid>
Oct 30 11:09:49 user nova-compute[74278]:   <name>instance-00000026</name>
Oct 30 11:09:49 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:09:49 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:09:49 user nova-compute[74278]:   <metadata>
Oct 30 11:09:49 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:09:49 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:09:49 user nova-compute[74278]:       <nova:name>tempest-ServerActionsTestOtherA-server-238911529</nova:name>
Oct 30 11:09:49 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:09:48</nova:creationTime>
Oct 30 11:09:49 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:09:49 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:09:49 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:09:49 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:09:49 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:09:49 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:09:49 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:09:49 user nova-compute[74278]:       <nova:owner>
Oct 30 11:09:49 user nova-compute[74278]:         <nova:user uuid="1b9a38bd9c4e4717b9499ed404ed2d6d">tempest-ServerActionsTestOtherA-1217247754-project-member</nova:user>
Oct 30 11:09:49 user nova-compute[74278]:         <nova:project uuid="d8215346d10443799d5d450114b09386">tempest-ServerActionsTestOtherA-1217247754</nova:project>
Oct 30 11:09:49 user nova-compute[74278]:       </nova:owner>
Oct 30 11:09:49 user nova-compute[74278]:       <nova:ports>
Oct 30 11:09:49 user nova-compute[74278]:         <nova:port uuid="8de72719-56c4-4be2-b3f6-f4207ae8f395">
Oct 30 11:09:49 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 11:09:49 user nova-compute[74278]:         </nova:port>
Oct 30 11:09:49 user nova-compute[74278]:       </nova:ports>
Oct 30 11:09:49 user nova-compute[74278]:     </nova:instance>
Oct 30 11:09:49 user nova-compute[74278]:   </metadata>
Oct 30 11:09:49 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:09:49 user nova-compute[74278]:     <system>
Oct 30 11:09:49 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:09:49 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:09:49 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:09:49 user nova-compute[74278]:       <entry name="serial">a2cde4ee-e665-457a-b5f0-652a2c2b7f49</entry>
Oct 30 11:09:49 user nova-compute[74278]:       <entry name="uuid">a2cde4ee-e665-457a-b5f0-652a2c2b7f49</entry>
Oct 30 11:09:49 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:09:49 user nova-compute[74278]:     </system>
Oct 30 11:09:49 user nova-compute[74278]:   </sysinfo>
Oct 30 11:09:49 user nova-compute[74278]:   <os>
Oct 30 11:09:49 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:09:49 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:09:49 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:09:49 user nova-compute[74278]:   </os>
Oct 30 11:09:49 user nova-compute[74278]:   <features>
Oct 30 11:09:49 user nova-compute[74278]:     <acpi/>
Oct 30 11:09:49 user nova-compute[74278]:     <apic/>
Oct 30 11:09:49 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:09:49 user nova-compute[74278]:   </features>
Oct 30 11:09:49 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:09:49 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:09:49 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:09:49 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:09:49 user nova-compute[74278]:   </clock>
Oct 30 11:09:49 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:09:49 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:09:49 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:09:49 user nova-compute[74278]:   </cpu>
Oct 30 11:09:49 user nova-compute[74278]:   <devices>
Oct 30 11:09:49 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:09:49 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:09:49 user nova-compute[74278]:       <source dev="/dev/sdc"/>
Oct 30 11:09:49 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:09:49 user nova-compute[74278]:       <serial>32a94a98-5e5d-4bde-89ad-576a82f2060f</serial>
Oct 30 11:09:49 user nova-compute[74278]:     </disk>
Oct 30 11:09:49 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:09:49 user nova-compute[74278]:       <mac address="fa:16:3e:57:29:0b"/>
Oct 30 11:09:49 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:09:49 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:09:49 user nova-compute[74278]:       <target dev="tap8de72719-56"/>
Oct 30 11:09:49 user nova-compute[74278]:     </interface>
Oct 30 11:09:49 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:09:49 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/a2cde4ee-e665-457a-b5f0-652a2c2b7f49/console.log" append="off"/>
Oct 30 11:09:49 user nova-compute[74278]:     </serial>
Oct 30 11:09:49 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:09:49 user nova-compute[74278]:     <video>
Oct 30 11:09:49 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:09:49 user nova-compute[74278]:     </video>
Oct 30 11:09:49 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:09:49 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:09:49 user nova-compute[74278]:     </rng>
Oct 30 11:09:49 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:09:49 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:09:49 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:09:49 user nova-compute[74278]:     </memballoon>
Oct 30 11:09:49 user nova-compute[74278]:   </devices>
Oct 30 11:09:49 user nova-compute[74278]: </domain>
Oct 30 11:09:49 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-238911529',display_name='tempest-ServerActionsTestOtherA-server-238911529',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-238911529',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+yfE1fzC0NeFR+gspIaPJ/CcDdqYlrTD1/gMueYz50h0LQsw5TCBiSQS0P2divdfLo9Fj2hNvf4LMgeazslsUbDPOdzcoch9KTxV2Qpnb5QJ+Ahxn1Nm/kcqA+i5KG3A==',key_name='tempest-keypair-148099064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-zwruvzc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=a2cde4ee-e665-457a-b5f0-652a2c2b7f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG os_vif [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5e1e78c-c161-552e-a142-142a3362de4f', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8de72719-56, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8de72719-56, col_values=(('qos', UUID('bc0231a9-a662-41f7-9872-86021df00670')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8de72719-56, col_values=(('external_ids', {'iface-id': '8de72719-56c4-4be2-b3f6-f4207ae8f395', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:29:0b', 'vm-uuid': 'a2cde4ee-e665-457a-b5f0-652a2c2b7f49'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:49 user nova-compute[74278]: INFO os_vif [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56')
Oct 30 11:09:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:09:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No VIF found with MAC fa:16:3e:57:29:0b, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:09:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:51 user nova-compute[74278]: DEBUG nova.compute.manager [req-2794e6d6-f331-4157-bbfc-98c872674a38 req-21af91df-4eb4-4075-a783-671c1788667b service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received event network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2794e6d6-f331-4157-bbfc-98c872674a38 req-21af91df-4eb4-4075-a783-671c1788667b service nova] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2794e6d6-f331-4157-bbfc-98c872674a38 req-21af91df-4eb4-4075-a783-671c1788667b service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2794e6d6-f331-4157-bbfc-98c872674a38 req-21af91df-4eb4-4075-a783-671c1788667b service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:51 user nova-compute[74278]: DEBUG nova.compute.manager [req-2794e6d6-f331-4157-bbfc-98c872674a38 req-21af91df-4eb4-4075-a783-671c1788667b service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] No waiting events found dispatching network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:09:51 user nova-compute[74278]: WARNING nova.compute.manager [req-2794e6d6-f331-4157-bbfc-98c872674a38 req-21af91df-4eb4-4075-a783-671c1788667b service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received unexpected event network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 for instance with vm_state building and task_state spawning.
Oct 30 11:09:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-a38918d1-157a-4ce8-bda0-fca41d5d44c9 req-f196f2a8-bc12-4a32-aac2-d4daa60bd1f3 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received event network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:09:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a38918d1-157a-4ce8-bda0-fca41d5d44c9 req-f196f2a8-bc12-4a32-aac2-d4daa60bd1f3 service nova] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:09:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a38918d1-157a-4ce8-bda0-fca41d5d44c9 req-f196f2a8-bc12-4a32-aac2-d4daa60bd1f3 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:09:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a38918d1-157a-4ce8-bda0-fca41d5d44c9 req-f196f2a8-bc12-4a32-aac2-d4daa60bd1f3 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-a38918d1-157a-4ce8-bda0-fca41d5d44c9 req-f196f2a8-bc12-4a32-aac2-d4daa60bd1f3 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] No waiting events found dispatching network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:09:53 user nova-compute[74278]: WARNING nova.compute.manager [req-a38918d1-157a-4ce8-bda0-fca41d5d44c9 req-f196f2a8-bc12-4a32-aac2-d4daa60bd1f3 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received unexpected event network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 for instance with vm_state building and task_state spawning.
Oct 30 11:09:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:09:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:09:53 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Instance spawned successfully.
Oct 30 11:09:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:09:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:09:53 user nova-compute[74278]: INFO nova.compute.manager [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 30 11:09:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:09:53 user nova-compute[74278]: INFO nova.compute.manager [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Took 29.57 seconds to build instance.
Oct 30 11:09:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5af839a3-55a5-4b92-a80c-0b11de49ebfc tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.677s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:09:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:09:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "2591f731-03b7-49b6-93af-c5b63e505127" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:02 user nova-compute[74278]: INFO nova.compute.manager [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Terminating instance
Oct 30 11:10:02 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG nova.compute.manager [req-16c58f80-a5a0-4dd2-833e-c6ad7415262c req-38c4e655-8d4d-4fe5-ba91-343bb75a287c service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-unplugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-16c58f80-a5a0-4dd2-833e-c6ad7415262c req-38c4e655-8d4d-4fe5-ba91-343bb75a287c service nova] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-16c58f80-a5a0-4dd2-833e-c6ad7415262c req-38c4e655-8d4d-4fe5-ba91-343bb75a287c service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-16c58f80-a5a0-4dd2-833e-c6ad7415262c req-38c4e655-8d4d-4fe5-ba91-343bb75a287c service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG nova.compute.manager [req-16c58f80-a5a0-4dd2-833e-c6ad7415262c req-38c4e655-8d4d-4fe5-ba91-343bb75a287c service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] No waiting events found dispatching network-vif-unplugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG nova.compute.manager [req-16c58f80-a5a0-4dd2-833e-c6ad7415262c req-38c4e655-8d4d-4fe5-ba91-343bb75a287c service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-unplugged-f8d17d66-8240-41ca-855d-531672079adb for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:03 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Instance destroyed successfully.
Oct 30 11:10:03 user nova-compute[74278]: DEBUG nova.objects.instance [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'resources' on Instance uuid 2591f731-03b7-49b6-93af-c5b63e505127 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:53:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-716124331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-716124331',id=13,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:55:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-guw9p7hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:57:12Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=2591f731-03b7-49b6-93af-c5b63e505127,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "f8d17d66-8240-41ca-855d-531672079adb", "address": "fa:16:3e:87:1d:9a", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d17d66-82", "ovs_interfaceid": "f8d17d66-8240-41ca-855d-531672079adb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:1d:9a,bridge_name='br-int',has_traffic_filtering=True,id=f8d17d66-8240-41ca-855d-531672079adb,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d17d66-82') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_vif [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:1d:9a,bridge_name='br-int',has_traffic_filtering=True,id=f8d17d66-8240-41ca-855d-531672079adb,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d17d66-82') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8d17d66-82, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70d4c731-cd2a-43a8-9b53-9780c5fb5e10) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:10:03 user nova-compute[74278]: INFO os_vif [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:1d:9a,bridge_name='br-int',has_traffic_filtering=True,id=f8d17d66-8240-41ca-855d-531672079adb,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d17d66-82')
Oct 30 11:10:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xDvLNukE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:10:03 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c3f103-5f4c-4321-ae14-882aa2e04804]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:10:03 user nova-compute[74278]: No targets found.
Oct 30 11:10:03 user nova-compute[74278]: iSNS:
Oct 30 11:10:03 user nova-compute[74278]: No targets found.
Oct 30 11:10:03 user nova-compute[74278]: STATIC:
Oct 30 11:10:03 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f
Oct 30 11:10:03 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:10:03 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:10:03 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1
Oct 30 11:10:03 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:10:03 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:10:03 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108
Oct 30 11:10:03 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:10:03 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:10:03 user nova-compute[74278]: FIRMWARE:
Oct 30 11:10:03 user nova-compute[74278]: No targets found.
Oct 30 11:10:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:10:03 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:10:03 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22550e0-2a72-4bda-a18c-da04567265ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30e5fb6-3a58-4acf-994e-f7a302a84f70]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:10:03 user nova-compute[74278]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:10:03 user nova-compute[74278]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:10:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 (non-flash)
Oct 30 11:10:03 user nova-compute[74278]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:10:03 user nova-compute[74278]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:10:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac26c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1'): ({'sdf'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Removing single pathed devices sdf {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa38afe0-3015-43a5-a65b-2f4121832075]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.032s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4967e9e8-7094-48f1-8415-a3a15ab6894b]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Flushing IO for device /dev/sdf {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b387df0-a2a3-4ce9-b947-54cf98842659]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[28488c23-f9cd-4419-b848-7db4d1ecdb3a]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] SCSI volumes sdf have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[579e9397-595a-4fb8-a6ee-b9b7020557a8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:10:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[485adbd2-11b9-46a1-b5fe-e6bd464d7203]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1, portal: 172.16.0.220,3260]
Oct 30 11:10:04 user nova-compute[74278]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1, portal: 172.16.0.220,3260] successful.
Oct 30 11:10:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32778937-dac7-439c-89b4-6275dcdc17a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[393fcc9e-3ec1-4ffd-b490-b5d74397ae8c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] <== disconnect_volume: return (388ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:10:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Deleting instance files /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127_del
Oct 30 11:10:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Deletion of /opt/stack/data/nova/instances/2591f731-03b7-49b6-93af-c5b63e505127_del complete
Oct 30 11:10:04 user nova-compute[74278]: INFO nova.compute.manager [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 30 11:10:04 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:10:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-5da8da18-15e2-4cd4-8b90-e4e46f7d8ca1 req-adddfcf9-241a-4556-a08f-438bdecc840b service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-deleted-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:10:04 user nova-compute[74278]: INFO nova.compute.manager [req-5da8da18-15e2-4cd4-8b90-e4e46f7d8ca1 req-adddfcf9-241a-4556-a08f-438bdecc840b service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Neutron deleted interface f8d17d66-8240-41ca-855d-531672079adb; detaching it from the instance and deleting it from the info cache
Oct 30 11:10:04 user nova-compute[74278]: DEBUG nova.network.neutron [req-5da8da18-15e2-4cd4-8b90-e4e46f7d8ca1 req-adddfcf9-241a-4556-a08f-438bdecc840b service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:10:04 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Took 0.67 seconds to deallocate network for instance.
Oct 30 11:10:04 user nova-compute[74278]: DEBUG nova.compute.manager [req-5da8da18-15e2-4cd4-8b90-e4e46f7d8ca1 req-adddfcf9-241a-4556-a08f-438bdecc840b service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Detach interface failed, port_id=f8d17d66-8240-41ca-855d-531672079adb, reason: Instance 2591f731-03b7-49b6-93af-c5b63e505127 could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:10:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-e3a41125-2606-43ca-ab99-1e4539c9f188 req-1cf66927-22e2-43f1-a6c4-e901171837ff service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:10:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e3a41125-2606-43ca-ab99-1e4539c9f188 req-1cf66927-22e2-43f1-a6c4-e901171837ff service nova] Acquiring lock "2591f731-03b7-49b6-93af-c5b63e505127-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e3a41125-2606-43ca-ab99-1e4539c9f188 req-1cf66927-22e2-43f1-a6c4-e901171837ff service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e3a41125-2606-43ca-ab99-1e4539c9f188 req-1cf66927-22e2-43f1-a6c4-e901171837ff service nova] Lock "2591f731-03b7-49b6-93af-c5b63e505127-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-e3a41125-2606-43ca-ab99-1e4539c9f188 req-1cf66927-22e2-43f1-a6c4-e901171837ff service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] No waiting events found dispatching network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:10:05 user nova-compute[74278]: WARNING nova.compute.manager [req-e3a41125-2606-43ca-ab99-1e4539c9f188 req-1cf66927-22e2-43f1-a6c4-e901171837ff service nova] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Received unexpected event network-vif-plugged-f8d17d66-8240-41ca-855d-531672079adb for instance with vm_state active and task_state deleting.
Oct 30 11:10:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-eb7a1a28-49e4-45b1-9f2e-56aaa60715da req-125b806f-5251-46cd-a615-4fdae10df129 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-changed-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:10:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-eb7a1a28-49e4-45b1-9f2e-56aaa60715da req-125b806f-5251-46cd-a615-4fdae10df129 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Refreshing instance network info cache due to event network-changed-8eba06a8-c7a5-478f-8924-bc26b35789c7. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:10:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eb7a1a28-49e4-45b1-9f2e-56aaa60715da req-125b806f-5251-46cd-a615-4fdae10df129 service nova] Acquiring lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:10:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eb7a1a28-49e4-45b1-9f2e-56aaa60715da req-125b806f-5251-46cd-a615-4fdae10df129 service nova] Acquired lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:10:06 user nova-compute[74278]: DEBUG nova.network.neutron [req-eb7a1a28-49e4-45b1-9f2e-56aaa60715da req-125b806f-5251-46cd-a615-4fdae10df129 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Refreshing network info cache for port 8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:10:07 user nova-compute[74278]: DEBUG nova.network.neutron [req-eb7a1a28-49e4-45b1-9f2e-56aaa60715da req-125b806f-5251-46cd-a615-4fdae10df129 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updated VIF entry in instance network info cache for port 8eba06a8-c7a5-478f-8924-bc26b35789c7. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:10:07 user nova-compute[74278]: DEBUG nova.network.neutron [req-eb7a1a28-49e4-45b1-9f2e-56aaa60715da req-125b806f-5251-46cd-a615-4fdae10df129 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updating instance_info_cache with network_info: [{"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:10:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eb7a1a28-49e4-45b1-9f2e-56aaa60715da req-125b806f-5251-46cd-a615-4fdae10df129 service nova] Releasing lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:10:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:09 user nova-compute[74278]: INFO nova.compute.manager [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: 2591f731-03b7-49b6-93af-c5b63e505127] Took 4.39 seconds to detach 1 volumes for instance.
Oct 30 11:10:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:10 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:10:10 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:10:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.916s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:10 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Deleted allocations for instance 2591f731-03b7-49b6-93af-c5b63e505127
Oct 30 11:10:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b41e6253-6f3f-4178-9165-7a5ea86b3d04 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "2591f731-03b7-49b6-93af-c5b63e505127" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.460s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "290c5792-7212-4a44-bf02-b51133a118ed" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:16 user nova-compute[74278]: INFO nova.compute.manager [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Shelving
Oct 30 11:10:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-01303046-b038-4bc7-9dc0-cef590c19fce req-198352da-7418-40b5-a7ea-17b609fe3a84 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-vif-unplugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:10:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-01303046-b038-4bc7-9dc0-cef590c19fce req-198352da-7418-40b5-a7ea-17b609fe3a84 service nova] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-01303046-b038-4bc7-9dc0-cef590c19fce req-198352da-7418-40b5-a7ea-17b609fe3a84 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-01303046-b038-4bc7-9dc0-cef590c19fce req-198352da-7418-40b5-a7ea-17b609fe3a84 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-01303046-b038-4bc7-9dc0-cef590c19fce req-198352da-7418-40b5-a7ea-17b609fe3a84 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] No waiting events found dispatching network-vif-unplugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:10:17 user nova-compute[74278]: WARNING nova.compute.manager [req-01303046-b038-4bc7-9dc0-cef590c19fce req-198352da-7418-40b5-a7ea-17b609fe3a84 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received unexpected event network-vif-unplugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 for instance with vm_state active and task_state shelving.
Oct 30 11:10:17 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Instance destroyed successfully.
Oct 30 11:10:17 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Beginning cold snapshot process
Oct 30 11:10:17 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 11:10:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk /opt/stack/data/nova/instances/snapshots/tmp3zdlzelc/6bca79487fe849ce95bf6eb73c46cbd8 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk /opt/stack/data/nova/instances/snapshots/tmp3zdlzelc/6bca79487fe849ce95bf6eb73c46cbd8" returned: 0 in 1.274s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:18 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Snapshot extracted, beginning image upload
Oct 30 11:10:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-f1452b29-9af5-4fa2-8857-2259dc5a898a req-ecbfe952-5501-4df4-9c60-e677ec02d806 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:10:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f1452b29-9af5-4fa2-8857-2259dc5a898a req-ecbfe952-5501-4df4-9c60-e677ec02d806 service nova] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f1452b29-9af5-4fa2-8857-2259dc5a898a req-ecbfe952-5501-4df4-9c60-e677ec02d806 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f1452b29-9af5-4fa2-8857-2259dc5a898a req-ecbfe952-5501-4df4-9c60-e677ec02d806 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-f1452b29-9af5-4fa2-8857-2259dc5a898a req-ecbfe952-5501-4df4-9c60-e677ec02d806 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] No waiting events found dispatching network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:10:19 user nova-compute[74278]: WARNING nova.compute.manager [req-f1452b29-9af5-4fa2-8857-2259dc5a898a req-ecbfe952-5501-4df4-9c60-e677ec02d806 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received unexpected event network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 for instance with vm_state active and task_state shelving_image_uploading.
Oct 30 11:10:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Snapshot image upload complete
Oct 30 11:10:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:10:22 user nova-compute[74278]: INFO nova.compute.manager [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Shelve offloading
Oct 30 11:10:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Instance destroyed successfully.
Oct 30 11:10:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:10:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:10:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquired lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:10:22 user nova-compute[74278]: DEBUG nova.network.neutron [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:10:22 user nova-compute[74278]: DEBUG nova.network.neutron [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updating instance_info_cache with network_info: [{"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:10:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Releasing lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:10:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Instance destroyed successfully.
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'resources' on Instance uuid 290c5792-7212-4a44-bf02-b51133a118ed {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1860907579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1860907579',id=35,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFztOITLCEzqku21cyYAqalG2M4MjHC5UyyK86MtvbzG9S3kb5fO7HAXi5Tf60HBBPdXMmXKdFP3tSLiQbRQcZqjkBRAaao6856gtutBal3xNcRO8Ff2vYGxE8xRxbenA==',key_name='tempest-keypair-1069109495',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='31dd01e2d9be4a0b96e94493f8eb43d7',ramdisk_id='',reservation_id='r-zqi01yl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2142703659',owner_user_name='tempest-AttachVolumeShelveTestJSON-2142703659-project-member',shelved_at='2023-10-30T11:10:22.026648',shelved_host='user',shelved_image_id='136f4e68-cd15-4f1b-9bbd-87562b7b0631'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:10:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584de218cec24240a91845deca515efa',uuid=290c5792-7212-4a44-bf02-b51133a118ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converting VIF {"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG os_vif [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eba06a8-c7, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-eaedc5af-5f80-4cd3-98b6-4e4894369e22 req-3a8f5096-72b5-4fab-8c16-2c917cfcd9e5 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-changed-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-eaedc5af-5f80-4cd3-98b6-4e4894369e22 req-3a8f5096-72b5-4fab-8c16-2c917cfcd9e5 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Refreshing instance network info cache due to event network-changed-8eba06a8-c7a5-478f-8924-bc26b35789c7. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eaedc5af-5f80-4cd3-98b6-4e4894369e22 req-3a8f5096-72b5-4fab-8c16-2c917cfcd9e5 service nova] Acquiring lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eaedc5af-5f80-4cd3-98b6-4e4894369e22 req-3a8f5096-72b5-4fab-8c16-2c917cfcd9e5 service nova] Acquired lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.network.neutron [req-eaedc5af-5f80-4cd3-98b6-4e4894369e22 req-3a8f5096-72b5-4fab-8c16-2c917cfcd9e5 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Refreshing network info cache for port 8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=483a36cd-3327-4c60-83df-5edaa3dcd3d7) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:10:23 user nova-compute[74278]: INFO os_vif [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7')
Oct 30 11:10:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Deleting instance files /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed_del
Oct 30 11:10:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Deletion of /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed_del complete
Oct 30 11:10:23 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Deleted allocations for instance 290c5792-7212-4a44-bf02-b51133a118ed
Oct 30 11:10:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'numa_topology' on Instance uuid 290c5792-7212-4a44-bf02-b51133a118ed {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.objects.base [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Object Instance<290c5792-7212-4a44-bf02-b51133a118ed> lazy-loaded attributes: resources,numa_topology {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.network.neutron [req-eaedc5af-5f80-4cd3-98b6-4e4894369e22 req-3a8f5096-72b5-4fab-8c16-2c917cfcd9e5 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updated VIF entry in instance network info cache for port 8eba06a8-c7a5-478f-8924-bc26b35789c7. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG nova.network.neutron [req-eaedc5af-5f80-4cd3-98b6-4e4894369e22 req-3a8f5096-72b5-4fab-8c16-2c917cfcd9e5 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updating instance_info_cache with network_info: [{"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eaedc5af-5f80-4cd3-98b6-4e4894369e22 req-3a8f5096-72b5-4fab-8c16-2c917cfcd9e5 service nova] Releasing lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:10:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a13dd462-7dff-40a2-a797-3f6884d13bd7 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "290c5792-7212-4a44-bf02-b51133a118ed" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.193s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:29 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:10:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:34 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:10:34 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:10:34 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 11:10:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:10:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:10:34 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:10:34 user nova-compute[74278]: DEBUG nova.objects.instance [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lazy-loading 'info_cache' on Instance uuid da67673a-dbe6-419f-8547-5ca730f14003 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:10:35 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Updating instance_info_cache with network_info: [{"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:10:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-da67673a-dbe6-419f-8547-5ca730f14003" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:10:35 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:10:35 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:10:35 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:10:35 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:10:35 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:10:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:10:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:10:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:10:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:10:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:10:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:10:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:10:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:10:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:10:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:10:42 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:10:42 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:10:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=7946MB free_disk=24.866985321044922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance da67673a-dbe6-419f-8547-5ca730f14003 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0274d8c3-6a83-4959-85a6-4b8168a43df0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a6704568-651d-4732-b272-79f0b768b96c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a2cde4ee-e665-457a-b5f0-652a2c2b7f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 453b1f71-8dc2-4f91-923a-dd183f2ec3ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:10:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:10:43 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:10:43 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:10:43 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:10:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:10:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:10:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "da67673a-dbe6-419f-8547-5ca730f14003" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "da67673a-dbe6-419f-8547-5ca730f14003" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "da67673a-dbe6-419f-8547-5ca730f14003-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "da67673a-dbe6-419f-8547-5ca730f14003-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "da67673a-dbe6-419f-8547-5ca730f14003-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:53 user nova-compute[74278]: INFO nova.compute.manager [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Terminating instance
Oct 30 11:10:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-ccaef004-687a-447b-910d-bfe0bc101b3a req-5e200c3b-3aab-424f-9278-5241d922aae9 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Received event network-vif-unplugged-a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ccaef004-687a-447b-910d-bfe0bc101b3a req-5e200c3b-3aab-424f-9278-5241d922aae9 service nova] Acquiring lock "da67673a-dbe6-419f-8547-5ca730f14003-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ccaef004-687a-447b-910d-bfe0bc101b3a req-5e200c3b-3aab-424f-9278-5241d922aae9 service nova] Lock "da67673a-dbe6-419f-8547-5ca730f14003-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ccaef004-687a-447b-910d-bfe0bc101b3a req-5e200c3b-3aab-424f-9278-5241d922aae9 service nova] Lock "da67673a-dbe6-419f-8547-5ca730f14003-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-ccaef004-687a-447b-910d-bfe0bc101b3a req-5e200c3b-3aab-424f-9278-5241d922aae9 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] No waiting events found dispatching network-vif-unplugged-a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-ccaef004-687a-447b-910d-bfe0bc101b3a req-5e200c3b-3aab-424f-9278-5241d922aae9 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Received event network-vif-unplugged-a2d0d57d-3df3-474d-b718-c539fb517f32 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:10:54 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Instance destroyed successfully.
Oct 30 11:10:54 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lazy-loading 'resources' on Instance uuid da67673a-dbe6-419f-8547-5ca730f14003 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1492633529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1492633529',id=2,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:50:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f6de366be034e23a4d60302674b76c9',ramdisk_id='',reservation_id='r-rc5qhn2y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:52:20Z,user_data=None,user_id='e6e338955c2f4d4fae81e9fbf93eff39',uuid=da67673a-dbe6-419f-8547-5ca730f14003,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converting VIF {"id": "a2d0d57d-3df3-474d-b718-c539fb517f32", "address": "fa:16:3e:bf:20:bf", "network": {"id": "d89c9ef4-4a61-44fc-8946-9f8ee72f64a8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-649623586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f6de366be034e23a4d60302674b76c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2d0d57d-3d", "ovs_interfaceid": "a2d0d57d-3df3-474d-b718-c539fb517f32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:20:bf,bridge_name='br-int',has_traffic_filtering=True,id=a2d0d57d-3df3-474d-b718-c539fb517f32,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2d0d57d-3d') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG os_vif [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:20:bf,bridge_name='br-int',has_traffic_filtering=True,id=a2d0d57d-3df3-474d-b718-c539fb517f32,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2d0d57d-3d') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2d0d57d-3d, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43dade31-dcaa-46b9-a819-2c177b9307a0) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:10:54 user nova-compute[74278]: INFO os_vif [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:20:bf,bridge_name='br-int',has_traffic_filtering=True,id=a2d0d57d-3df3-474d-b718-c539fb517f32,network=Network(d89c9ef4-4a61-44fc-8946-9f8ee72f64a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2d0d57d-3d')
Oct 30 11:10:54 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Deleting instance files /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003_del
Oct 30 11:10:54 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Deletion of /opt/stack/data/nova/instances/da67673a-dbe6-419f-8547-5ca730f14003_del complete
Oct 30 11:10:54 user nova-compute[74278]: INFO nova.compute.manager [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Took 0.65 seconds to destroy the instance on the hypervisor.
Oct 30 11:10:54 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:10:54 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: da67673a-dbe6-419f-8547-5ca730f14003] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:10:55 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:10:55 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Took 0.53 seconds to deallocate network for instance.
Oct 30 11:10:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-cffc40a9-20d1-43e5-bc91-c1ce9a174530 req-698e9151-4a58-41fb-9950-6ba579c17ef5 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Received event network-vif-deleted-a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:10:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:55 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:10:55 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:10:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:55 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Deleted allocations for instance da67673a-dbe6-419f-8547-5ca730f14003
Oct 30 11:10:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1d2802e8-2318-4a11-a3c2-7b136e8cf861 tempest-ServerBootFromVolumeStableRescueTest-1058902108 tempest-ServerBootFromVolumeStableRescueTest-1058902108-project-member] Lock "da67673a-dbe6-419f-8547-5ca730f14003" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.631s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-3c14cf1d-6c79-4c66-9acd-96edc8dcad56 req-163d0935-9ecb-4abf-88aa-58e279c6fa72 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Received event network-vif-plugged-a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:10:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3c14cf1d-6c79-4c66-9acd-96edc8dcad56 req-163d0935-9ecb-4abf-88aa-58e279c6fa72 service nova] Acquiring lock "da67673a-dbe6-419f-8547-5ca730f14003-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:10:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3c14cf1d-6c79-4c66-9acd-96edc8dcad56 req-163d0935-9ecb-4abf-88aa-58e279c6fa72 service nova] Lock "da67673a-dbe6-419f-8547-5ca730f14003-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:10:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3c14cf1d-6c79-4c66-9acd-96edc8dcad56 req-163d0935-9ecb-4abf-88aa-58e279c6fa72 service nova] Lock "da67673a-dbe6-419f-8547-5ca730f14003-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:10:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-3c14cf1d-6c79-4c66-9acd-96edc8dcad56 req-163d0935-9ecb-4abf-88aa-58e279c6fa72 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] No waiting events found dispatching network-vif-plugged-a2d0d57d-3df3-474d-b718-c539fb517f32 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:10:56 user nova-compute[74278]: WARNING nova.compute.manager [req-3c14cf1d-6c79-4c66-9acd-96edc8dcad56 req-163d0935-9ecb-4abf-88aa-58e279c6fa72 service nova] [instance: da67673a-dbe6-419f-8547-5ca730f14003] Received unexpected event network-vif-plugged-a2d0d57d-3df3-474d-b718-c539fb517f32 for instance with vm_state deleted and task_state None.
Oct 30 11:10:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:10:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-356dcdd1-4115-4b1f-b5fd-93b296ff43f4 req-ebe7558f-4e20-4599-8d16-80bff7988df1 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-changed-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-356dcdd1-4115-4b1f-b5fd-93b296ff43f4 req-ebe7558f-4e20-4599-8d16-80bff7988df1 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Refreshing instance network info cache due to event network-changed-1491bcc7-6199-4857-a8b0-ad1efc591df5. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:11:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-356dcdd1-4115-4b1f-b5fd-93b296ff43f4 req-ebe7558f-4e20-4599-8d16-80bff7988df1 service nova] Acquiring lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:11:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-356dcdd1-4115-4b1f-b5fd-93b296ff43f4 req-ebe7558f-4e20-4599-8d16-80bff7988df1 service nova] Acquired lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:11:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-356dcdd1-4115-4b1f-b5fd-93b296ff43f4 req-ebe7558f-4e20-4599-8d16-80bff7988df1 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Refreshing network info cache for port 1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG nova.network.neutron [req-356dcdd1-4115-4b1f-b5fd-93b296ff43f4 req-ebe7558f-4e20-4599-8d16-80bff7988df1 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updated VIF entry in instance network info cache for port 1491bcc7-6199-4857-a8b0-ad1efc591df5. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG nova.network.neutron [req-356dcdd1-4115-4b1f-b5fd-93b296ff43f4 req-ebe7558f-4e20-4599-8d16-80bff7988df1 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating instance_info_cache with network_info: [{"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-356dcdd1-4115-4b1f-b5fd-93b296ff43f4 req-ebe7558f-4e20-4599-8d16-80bff7988df1 service nova] Releasing lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:01 user nova-compute[74278]: INFO nova.compute.manager [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Shelve offloading
Oct 30 11:11:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-002fdb37-a403-4f45-8cf1-058ea0490d9a req-a7c39d29-643b-4e55-a0d5-7b983cb9e481 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-vif-unplugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-002fdb37-a403-4f45-8cf1-058ea0490d9a req-a7c39d29-643b-4e55-a0d5-7b983cb9e481 service nova] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-002fdb37-a403-4f45-8cf1-058ea0490d9a req-a7c39d29-643b-4e55-a0d5-7b983cb9e481 service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-002fdb37-a403-4f45-8cf1-058ea0490d9a req-a7c39d29-643b-4e55-a0d5-7b983cb9e481 service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-002fdb37-a403-4f45-8cf1-058ea0490d9a req-a7c39d29-643b-4e55-a0d5-7b983cb9e481 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] No waiting events found dispatching network-vif-unplugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:11:01 user nova-compute[74278]: WARNING nova.compute.manager [req-002fdb37-a403-4f45-8cf1-058ea0490d9a req-a7c39d29-643b-4e55-a0d5-7b983cb9e481 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received unexpected event network-vif-unplugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 for instance with vm_state active and task_state shelving.
Oct 30 11:11:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Instance destroyed successfully.
Oct 30 11:11:01 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquired lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:11:01 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG nova.network.neutron [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating instance_info_cache with network_info: [{"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Releasing lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:02 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Instance destroyed successfully.
Oct 30 11:11:02 user nova-compute[74278]: DEBUG nova.objects.instance [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lazy-loading 'resources' on Instance uuid 0274d8c3-6a83-4959-85a6-4b8168a43df0 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1141748642',display_name='tempest-TestShelveInstance-server-1141748642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1141748642',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjajcqPMAHLG5BDRh8OD9ZGA5CKTelBhRuT/G7iIHJd8dsF5nAIa7BHI3I4Fbbc5SqqA/eYbWHvIRDp5Is/LZBwmEgeiE8F2co+QnBDTqzi8c7WBLfkmSY+V8sZ+/nj0g==',key_name='tempest-TestShelveInstance-1615884152',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:09:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af9e783ec7f44a65b46dac4e2c11e5b1',ramdisk_id='',reservation_id='r-e80lsc1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1856925634',owner_user_name='tempest-TestShelveInstance-1856925634-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:09:38Z,user_data=None,user_id='6b92838c59a9488bb72de434b984abf7',uuid=0274d8c3-6a83-4959-85a6-4b8168a43df0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Converting VIF {"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG os_vif [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1491bcc7-61, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-30ed62b1-2086-40c2-8835-dfde7e427c48 req-2a09ff16-c412-4806-bf20-514bb727cf57 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-changed-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-30ed62b1-2086-40c2-8835-dfde7e427c48 req-2a09ff16-c412-4806-bf20-514bb727cf57 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Refreshing instance network info cache due to event network-changed-1491bcc7-6199-4857-a8b0-ad1efc591df5. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-30ed62b1-2086-40c2-8835-dfde7e427c48 req-2a09ff16-c412-4806-bf20-514bb727cf57 service nova] Acquiring lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-30ed62b1-2086-40c2-8835-dfde7e427c48 req-2a09ff16-c412-4806-bf20-514bb727cf57 service nova] Acquired lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG nova.network.neutron [req-30ed62b1-2086-40c2-8835-dfde7e427c48 req-2a09ff16-c412-4806-bf20-514bb727cf57 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Refreshing network info cache for port 1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=372e4f85-6387-4744-a94a-99e09eaf9ddd) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:11:02 user nova-compute[74278]: INFO os_vif [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61')
Oct 30 11:11:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdTxZNec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:11:02 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:11:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:11:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5467ffd-3066-447d-bd0e-d7ec84e66470]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:11:03 user nova-compute[74278]: No targets found.
Oct 30 11:11:03 user nova-compute[74278]: iSNS:
Oct 30 11:11:03 user nova-compute[74278]: No targets found.
Oct 30 11:11:03 user nova-compute[74278]: STATIC:
Oct 30 11:11:03 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f
Oct 30 11:11:03 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:11:03 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:11:03 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108
Oct 30 11:11:03 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:11:03 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:11:03 user nova-compute[74278]: FIRMWARE:
Oct 30 11:11:03 user nova-compute[74278]: No targets found.
Oct 30 11:11:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:11:03 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:11:03 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afa78cc-c8ba-4c85-8f9e-3a24ed8651e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1adc3d-9eb6-4146-8d9c-b3529823458a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:11:03 user nova-compute[74278]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:11:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:11:03 user nova-compute[74278]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:11:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c354ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32cf993-5b17-4d35-b852-1ed6ae635911]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[280f038c-588b-4a65-94b4-5006100080a5]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[845b1e4c-59e3-491f-91a6-e5d48391d4ec]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb721c7f-ce2a-40e9-bd4c-77061aa91975]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a3ab5a-5868-4bec-81bf-3aa901e056f0]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ff1989-2c97-4bc8-9fae-ff67b8980a49]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260]
Oct 30 11:11:03 user nova-compute[74278]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260] successful.
Oct 30 11:11:03 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6f7621-eacc-425a-97d5-e7e0288497fb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] <== disconnect_volume: return (323ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:11:03 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Deleting instance files /opt/stack/data/nova/instances/0274d8c3-6a83-4959-85a6-4b8168a43df0_del
Oct 30 11:11:03 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Deletion of /opt/stack/data/nova/instances/0274d8c3-6a83-4959-85a6-4b8168a43df0_del complete
Oct 30 11:11:03 user nova-compute[74278]: DEBUG nova.network.neutron [req-30ed62b1-2086-40c2-8835-dfde7e427c48 req-2a09ff16-c412-4806-bf20-514bb727cf57 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updated VIF entry in instance network info cache for port 1491bcc7-6199-4857-a8b0-ad1efc591df5. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG nova.network.neutron [req-30ed62b1-2086-40c2-8835-dfde7e427c48 req-2a09ff16-c412-4806-bf20-514bb727cf57 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating instance_info_cache with network_info: [{"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": null, "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1491bcc7-61", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-30ed62b1-2086-40c2-8835-dfde7e427c48 req-2a09ff16-c412-4806-bf20-514bb727cf57 service nova] Releasing lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG nova.compute.manager [req-6fd58b78-6f52-4376-8700-7285a694789b req-ef6ad8d3-f68d-4bd5-a2e8-77658a2e8833 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6fd58b78-6f52-4376-8700-7285a694789b req-ef6ad8d3-f68d-4bd5-a2e8-77658a2e8833 service nova] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6fd58b78-6f52-4376-8700-7285a694789b req-ef6ad8d3-f68d-4bd5-a2e8-77658a2e8833 service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6fd58b78-6f52-4376-8700-7285a694789b req-ef6ad8d3-f68d-4bd5-a2e8-77658a2e8833 service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:03 user nova-compute[74278]: DEBUG nova.compute.manager [req-6fd58b78-6f52-4376-8700-7285a694789b req-ef6ad8d3-f68d-4bd5-a2e8-77658a2e8833 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] No waiting events found dispatching network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:11:03 user nova-compute[74278]: WARNING nova.compute.manager [req-6fd58b78-6f52-4376-8700-7285a694789b req-ef6ad8d3-f68d-4bd5-a2e8-77658a2e8833 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received unexpected event network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 for instance with vm_state active and task_state shelving.
Oct 30 11:11:04 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Deleted allocations for instance 0274d8c3-6a83-4959-85a6-4b8168a43df0
Oct 30 11:11:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lazy-loading 'numa_topology' on Instance uuid 0274d8c3-6a83-4959-85a6-4b8168a43df0 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:11:04 user nova-compute[74278]: DEBUG nova.objects.base [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Object Instance<0274d8c3-6a83-4959-85a6-4b8168a43df0> lazy-loaded attributes: resources,numa_topology {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:11:04 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:11:04 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:11:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4e713702-1a50-4e20-b81e-9850bba99208 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.782s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Acquiring lock "a6704568-651d-4732-b272-79f0b768b96c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "a6704568-651d-4732-b272-79f0b768b96c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Acquiring lock "a6704568-651d-4732-b272-79f0b768b96c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "a6704568-651d-4732-b272-79f0b768b96c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "a6704568-651d-4732-b272-79f0b768b96c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:08 user nova-compute[74278]: INFO nova.compute.manager [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Terminating instance
Oct 30 11:11:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:11:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:09 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a6704568-651d-4732-b272-79f0b768b96c] Instance destroyed successfully.
Oct 30 11:11:09 user nova-compute[74278]: DEBUG nova.objects.instance [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lazy-loading 'resources' on Instance uuid a6704568-651d-4732-b272-79f0b768b96c {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-959115173',display_name='tempest-VolumesNegativeTest-instance-959115173',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-959115173',id=37,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:09:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='821f55c16aa848729f8cc373347e5102',ramdisk_id='',reservation_id='r-eqjjstxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-372960210',owner_user_name='tempest-VolumesNegativeTest-372960210-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:09:25Z,user_data=None,user_id='b733da53a9b94530a4a85b19e8af1a5c',uuid=a6704568-651d-4732-b272-79f0b768b96c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db77bda8-29ee-428e-809f-3d102d95a9dd", "address": "fa:16:3e:74:15:8c", "network": {"id": "824c0402-cd5e-4166-99cf-0a59436847f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bad695133afe4787b2a24160056a5ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb77bda8-29", "ovs_interfaceid": "db77bda8-29ee-428e-809f-3d102d95a9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Converting VIF {"id": "db77bda8-29ee-428e-809f-3d102d95a9dd", "address": "fa:16:3e:74:15:8c", "network": {"id": "824c0402-cd5e-4166-99cf-0a59436847f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bad695133afe4787b2a24160056a5ca7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb77bda8-29", "ovs_interfaceid": "db77bda8-29ee-428e-809f-3d102d95a9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:15:8c,bridge_name='br-int',has_traffic_filtering=True,id=db77bda8-29ee-428e-809f-3d102d95a9dd,network=Network(824c0402-cd5e-4166-99cf-0a59436847f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb77bda8-29') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG os_vif [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:15:8c,bridge_name='br-int',has_traffic_filtering=True,id=db77bda8-29ee-428e-809f-3d102d95a9dd,network=Network(824c0402-cd5e-4166-99cf-0a59436847f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb77bda8-29') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb77bda8-29, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aae141b2-7801-4ef0-946b-089d80bc9475) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:09 user nova-compute[74278]: INFO os_vif [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:15:8c,bridge_name='br-int',has_traffic_filtering=True,id=db77bda8-29ee-428e-809f-3d102d95a9dd,network=Network(824c0402-cd5e-4166-99cf-0a59436847f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb77bda8-29')
Oct 30 11:11:09 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Deleting instance files /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c_del
Oct 30 11:11:09 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Deletion of /opt/stack/data/nova/instances/a6704568-651d-4732-b272-79f0b768b96c_del complete
Oct 30 11:11:09 user nova-compute[74278]: INFO nova.compute.manager [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] [instance: a6704568-651d-4732-b272-79f0b768b96c] Took 0.65 seconds to destroy the instance on the hypervisor.
Oct 30 11:11:09 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: a6704568-651d-4732-b272-79f0b768b96c] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:11:09 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: a6704568-651d-4732-b272-79f0b768b96c] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:11:10 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: a6704568-651d-4732-b272-79f0b768b96c] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:11:10 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: a6704568-651d-4732-b272-79f0b768b96c] Took 0.51 seconds to deallocate network for instance.
Oct 30 11:11:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-3f05bed4-8e32-4e22-a2b1-94a5e253a766 req-9a86cb28-f2af-45f0-8e52-adcf27dcb242 service nova] [instance: a6704568-651d-4732-b272-79f0b768b96c] Received event network-vif-deleted-db77bda8-29ee-428e-809f-3d102d95a9dd {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:10 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:11:10 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:11:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:10 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Deleted allocations for instance a6704568-651d-4732-b272-79f0b768b96c
Oct 30 11:11:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-275e2d05-dc19-4c7e-9f10-85c928dce55c tempest-VolumesNegativeTest-372960210 tempest-VolumesNegativeTest-372960210-project-member] Lock "a6704568-651d-4732-b272-79f0b768b96c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.616s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-0e5aa33a-103f-4d0a-b994-a28b0636382a req-7baab0ad-aeb2-4c8f-a62a-d8bd8ae67050 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received event network-changed-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-0e5aa33a-103f-4d0a-b994-a28b0636382a req-7baab0ad-aeb2-4c8f-a62a-d8bd8ae67050 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Refreshing instance network info cache due to event network-changed-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:11:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0e5aa33a-103f-4d0a-b994-a28b0636382a req-7baab0ad-aeb2-4c8f-a62a-d8bd8ae67050 service nova] Acquiring lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:11:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0e5aa33a-103f-4d0a-b994-a28b0636382a req-7baab0ad-aeb2-4c8f-a62a-d8bd8ae67050 service nova] Acquired lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:11:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-0e5aa33a-103f-4d0a-b994-a28b0636382a req-7baab0ad-aeb2-4c8f-a62a-d8bd8ae67050 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Refreshing network info cache for port 2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:11:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-0e5aa33a-103f-4d0a-b994-a28b0636382a req-7baab0ad-aeb2-4c8f-a62a-d8bd8ae67050 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updated VIF entry in instance network info cache for port 2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:11:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-0e5aa33a-103f-4d0a-b994-a28b0636382a req-7baab0ad-aeb2-4c8f-a62a-d8bd8ae67050 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updating instance_info_cache with network_info: [{"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:11:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0e5aa33a-103f-4d0a-b994-a28b0636382a req-7baab0ad-aeb2-4c8f-a62a-d8bd8ae67050 service nova] Releasing lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Stashing vm_state: active {{(pid=74278) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG nova.objects.instance [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lazy-loading 'flavor' on Instance uuid 453b1f71-8dc2-4f91-923a-dd183f2ec3ea {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:11:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Ignoring supplied device name: /dev/vdb
Oct 30 11:11:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:11:16 user nova-compute[74278]: INFO nova.compute.claims [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Claim successful on node user
Oct 30 11:11:16 user nova-compute[74278]: INFO nova.compute.resource_tracker [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating resource usage from migration 7b43f3c8-e9c8-42e9-b4a6-d03d89f60e31
Oct 30 11:11:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:16 user nova-compute[74278]: INFO nova.compute.manager [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Attaching volume 9d238f47-2363-4884-a95e-0cdf9ab7c7e7 to /dev/vdb
Oct 30 11:11:16 user nova-compute[74278]: DEBUG os_brick.utils [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[09277c64-fe8b-446b-a49d-29f62af3faf5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:16 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aedd6e-a00a-4388-ac3e-283fe97c4261]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.252s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:17 user nova-compute[74278]: INFO nova.compute.manager [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Migrating
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[209de7c6-885f-44f1-b262-ae706bbb300f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b287aad3-d590-4930-bd5c-e15f8e8b3375]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquired lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:11:17 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca37a3bb-15ed-45de-879e-2dca907a0208]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG os_brick.utils [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Updating existing volume attachment record: 3d14b16c-2bb2-4042-ab86-5c75ae0cac98 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received event network-changed-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Refreshing instance network info cache due to event network-changed-8de72719-56c4-4be2-b3f6-f4207ae8f395. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] Acquiring lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating instance_info_cache with network_info: [{"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Releasing lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] Acquired lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG nova.network.neutron [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Refreshing network info cache for port 8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Starting migrate_disk_and_power_off {{(pid=74278) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-26f25814-2d6d-4592-9ddd-0c893aab57d3 req-42354df4-aad3-4996-9cd4-4a5df7b4fdf5 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received event network-vif-unplugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-26f25814-2d6d-4592-9ddd-0c893aab57d3 req-42354df4-aad3-4996-9cd4-4a5df7b4fdf5 service nova] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-26f25814-2d6d-4592-9ddd-0c893aab57d3 req-42354df4-aad3-4996-9cd4-4a5df7b4fdf5 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-26f25814-2d6d-4592-9ddd-0c893aab57d3 req-42354df4-aad3-4996-9cd4-4a5df7b4fdf5 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-26f25814-2d6d-4592-9ddd-0c893aab57d3 req-42354df4-aad3-4996-9cd4-4a5df7b4fdf5 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] No waiting events found dispatching network-vif-unplugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:11:18 user nova-compute[74278]: WARNING nova.compute.manager [req-26f25814-2d6d-4592-9ddd-0c893aab57d3 req-42354df4-aad3-4996-9cd4-4a5df7b4fdf5 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received unexpected event network-vif-unplugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 for instance with vm_state active and task_state resize_migrating.
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updated VIF entry in instance network info cache for port 8de72719-56c4-4be2-b3f6-f4207ae8f395. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating instance_info_cache with network_info: [{"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] Releasing lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Received event network-changed-63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Refreshing instance network info cache due to event network-changed-63cb19f9-b71e-4400-9c40-e1108880fb85. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] Acquiring lock "refresh_cache-453b1f71-8dc2-4f91-923a-dd183f2ec3ea" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] Acquired lock "refresh_cache-453b1f71-8dc2-4f91-923a-dd183f2ec3ea" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Refreshing network info cache for port 63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:11:18 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Instance destroyed successfully.
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-238911529',display_name='tempest-ServerActionsTestOtherA-server-238911529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-238911529',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+yfE1fzC0NeFR+gspIaPJ/CcDdqYlrTD1/gMueYz50h0LQsw5TCBiSQS0P2divdfLo9Fj2hNvf4LMgeazslsUbDPOdzcoch9KTxV2Qpnb5QJ+Ahxn1Nm/kcqA+i5KG3A==',key_name='tempest-keypair-148099064',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:09:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-zwruvzc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=a2cde4ee-e665-457a-b5f0-652a2c2b7f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-346429249-network", "vif_mac": "fa:16:3e:57:29:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-346429249-network", "vif_mac": "fa:16:3e:57:29:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_vif [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8de72719-56, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc0231a9-a662-41f7-9872-86021df00670) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:11:18 user nova-compute[74278]: INFO os_vif [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56')
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXBJdloE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:11:18 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6523243c-33d7-4cfd-993c-1df8c12f71a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:11:18 user nova-compute[74278]: No targets found.
Oct 30 11:11:18 user nova-compute[74278]: iSNS:
Oct 30 11:11:18 user nova-compute[74278]: No targets found.
Oct 30 11:11:18 user nova-compute[74278]: STATIC:
Oct 30 11:11:18 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f
Oct 30 11:11:18 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:11:18 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:11:18 user nova-compute[74278]: FIRMWARE:
Oct 30 11:11:18 user nova-compute[74278]: No targets found.
Oct 30 11:11:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:11:18 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:11:18 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[17627852-e103-4b52-9478-64fa783607c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca606880-a63f-4718-8e88-1ec115d6ffa8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:11:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:11:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c32aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fecfb7-bf48-4a3f-85f8-879c0bc9730a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[814c9552-1aca-4afd-9eb3-ae005adb98de]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b5a53d-1f34-44b3-912a-85bd32a78626]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[63039dcb-bb2f-49bd-a03f-5605d715ea14]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26563356137363236', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1b3d1334', '/dev/disk/by-id/scsi-1SCST_BIO1b3d1334-ec5a7626934f4017') {{(pid=85487) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4cc178-9988-4f4b-990a-51f65e7e18ae]: (4, None) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Updated VIF entry in instance network info cache for port 63cb19f9-b71e-4400-9c40-e1108880fb85. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Updating instance_info_cache with network_info: [{"id": "63cb19f9-b71e-4400-9c40-e1108880fb85", "address": "fa:16:3e:36:67:d4", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63cb19f9-b7", "ovs_interfaceid": "63cb19f9-b71e-4400-9c40-e1108880fb85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4ef8a6-228d-4ddb-a1cb-588e708b84c5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a7daa552-130f-4bf6-bfb1-a3c33c3657a0 req-5563245c-2cf4-4ab8-887c-412b09cdb368 service nova] Releasing lock "refresh_cache-453b1f71-8dc2-4f91-923a-dd183f2ec3ea" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39b11c0-8eb8-4056-bfab-ef0b56205bd5]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260]
Oct 30 11:11:18 user nova-compute[74278]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260] successful.
Oct 30 11:11:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c2761-3cce-4397-9526-afebecd8d933]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== disconnect_volume: return (345ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:11:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:11:19 user nova-compute[74278]: DEBUG nova.network.neutron [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Port 8de72719-56c4-4be2-b3f6-f4207ae8f395 binding to destination host user is already ACTIVE {{(pid=74278) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-f7632de8-8f0f-4097-aecd-c946c4e7726e req-ed1b8cfe-8022-4eb9-9ccb-56d1c75c56c2 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received event network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f7632de8-8f0f-4097-aecd-c946c4e7726e req-ed1b8cfe-8022-4eb9-9ccb-56d1c75c56c2 service nova] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f7632de8-8f0f-4097-aecd-c946c4e7726e req-ed1b8cfe-8022-4eb9-9ccb-56d1c75c56c2 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f7632de8-8f0f-4097-aecd-c946c4e7726e req-ed1b8cfe-8022-4eb9-9ccb-56d1c75c56c2 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-f7632de8-8f0f-4097-aecd-c946c4e7726e req-ed1b8cfe-8022-4eb9-9ccb-56d1c75c56c2 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] No waiting events found dispatching network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:11:20 user nova-compute[74278]: WARNING nova.compute.manager [req-f7632de8-8f0f-4097-aecd-c946c4e7726e req-ed1b8cfe-8022-4eb9-9ccb-56d1c75c56c2 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received unexpected event network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 for instance with vm_state active and task_state resize_migrated.
Oct 30 11:11:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquired lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG nova.network.neutron [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG nova.network.neutron [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating instance_info_cache with network_info: [{"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:11:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Releasing lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG os_brick.utils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[845fee58-b289-4d50-8aa5-7861582710cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e59d7f8-3ed0-4bb0-a803-c64fda736cf8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7446e3-abbe-4d9f-8d75-d1295fb83833]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2e404e-7742-4b4d-8533-0dcd468e8b54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:11:21 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:11:21 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9465410e-b3ab-4d92-a00a-f02d3f879cc8]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:11:21 user nova-compute[74278]: DEBUG os_brick.utils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:11:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:11:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:34 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:11:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "cbd67692-96bc-4770-b05e-744b4ecf834b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:34 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:11:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:34 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:11:34 user nova-compute[74278]: INFO nova.compute.claims [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Claim successful on node user
Oct 30 11:11:34 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:11:34 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:11:34 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:34 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:11:35 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:11:35 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:11:35 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:11:35 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:11:35 user nova-compute[74278]: DEBUG nova.policy [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e921926b3790497fb9630088c501af82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59235488214e4149a91d6c2d5a02dd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:11:35 user nova-compute[74278]: INFO nova.virt.block_device [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Booting with volume snapshot 60b4a816-8993-4d50-bcc2-1512a799343d at /dev/vda
Oct 30 11:11:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:35 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:11:35 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:11:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:11:35 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:11:35 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:11:35 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Successfully created port: c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updating instance_info_cache with network_info: [{"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Successfully updated port: c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "refresh_cache-cbd67692-96bc-4770-b05e-744b4ecf834b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquired lock "refresh_cache-cbd67692-96bc-4770-b05e-744b4ecf834b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-37299cae-7923-46ac-8c13-c3d5c6f2e16d req-7f3316ce-847b-415a-a55b-74276578d0a9 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Received event network-changed-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG nova.compute.manager [req-37299cae-7923-46ac-8c13-c3d5c6f2e16d req-7f3316ce-847b-415a-a55b-74276578d0a9 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Refreshing instance network info cache due to event network-changed-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-37299cae-7923-46ac-8c13-c3d5c6f2e16d req-7f3316ce-847b-415a-a55b-74276578d0a9 service nova] Acquiring lock "refresh_cache-cbd67692-96bc-4770-b05e-744b4ecf834b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Updating instance_info_cache with network_info: [{"id": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "address": "fa:16:3e:78:54:3d", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ef729a-0b", "ovs_interfaceid": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Releasing lock "refresh_cache-cbd67692-96bc-4770-b05e-744b4ecf834b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Instance network_info: |[{"id": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "address": "fa:16:3e:78:54:3d", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ef729a-0b", "ovs_interfaceid": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-37299cae-7923-46ac-8c13-c3d5c6f2e16d req-7f3316ce-847b-415a-a55b-74276578d0a9 service nova] Acquired lock "refresh_cache-cbd67692-96bc-4770-b05e-744b4ecf834b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:11:36 user nova-compute[74278]: DEBUG nova.network.neutron [req-37299cae-7923-46ac-8c13-c3d5c6f2e16d req-7f3316ce-847b-415a-a55b-74276578d0a9 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Refreshing network info cache for port c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbhCOfaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:11:37 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:11:37 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:11:37 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b912c0c-2812-47c0-8175-1e5f9a23492e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:11:37 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c34ef7-b99f-4604-81f8-0450f583dd94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7] added
Oct 30 11:11:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae47561-3cb4-41fc-b100-d9bc999598a0]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG nova.network.neutron [req-37299cae-7923-46ac-8c13-c3d5c6f2e16d req-7f3316ce-847b-415a-a55b-74276578d0a9 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Updated VIF entry in instance network info cache for port c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG nova.network.neutron [req-37299cae-7923-46ac-8c13-c3d5c6f2e16d req-7f3316ce-847b-415a-a55b-74276578d0a9 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Updating instance_info_cache with network_info: [{"id": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "address": "fa:16:3e:78:54:3d", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ef729a-0b", "ovs_interfaceid": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-37299cae-7923-46ac-8c13-c3d5c6f2e16d req-7f3316ce-847b-415a-a55b-74276578d0a9 service nova] Releasing lock "refresh_cache-cbd67692-96bc-4770-b05e-744b4ecf834b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f420631a-ca97-469b-a6af-6c0b2e46eccc]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbhCOfaE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MbhCOfaE" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5be4cd6-3261-4057-87f7-7e552bf41721]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MbhCOfaE'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1872b4-bec4-4f7e-b5b9-ce5957e1fc23]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a8f21b-fd4c-41dc-9fc0-0a57ec289bee]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 11:11:37 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 11:11:37 user nova-compute[74278]:  {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:11:37 user nova-compute[74278]: WARNING os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 11:11:37 user nova-compute[74278]: 
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2891edc2-23bc-4956-846d-6ced9f7606a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7, portal: 172.16.0.220,3260]
Oct 30 11:11:37 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7, portal: 172.16.0.220,3260] successful.
Oct 30 11:11:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[79055d2d-eadd-47cc-9584-5a234a4b271d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8802f6c-b02e-4072-9809-9b7df2c38149]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)
Oct 30 11:11:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)
Oct 30 11:11:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[593f2a94-145f-4751-aba4-0fdfffe27d99]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:11:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbhCOfaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26363393239386462', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363393239386462', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG nova.objects.instance [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lazy-loading 'flavor' on Instance uuid 453b1f71-8dc2-4f91-923a-dd183f2ec3ea {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:11:38 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:11:38 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:11:38 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:11:38 user nova-compute[74278]:   <serial>9d238f47-2363-4884-a95e-0cdf9ab7c7e7</serial>
Oct 30 11:11:38 user nova-compute[74278]: </disk>
Oct 30 11:11:38 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] No VIF found with MAC fa:16:3e:36:67:d4, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:11:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-253bc240-de5b-43c3-b88f-25cc99a8abce tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.022s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Starting finish_migration {{(pid=74278) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Instance directory exists: not creating {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 11:11:40 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Creating image(s)
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Ensure instance console log exists: /opt/stack/data/nova/instances/a2cde4ee-e665-457a-b5f0-652a2c2b7f49/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Start _get_guest_xml network_info=[{"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-346429249-network", "vif_mac": "fa:16:3e:57:29:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXBJdloE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a2cde4ee-e665-457a-b5f0-652a2c2b7f49', 'attached_at': '2023-10-30T11:11:40.000000', 'detached_at': '', 'volume_id': '32a94a98-5e5d-4bde-89ad-576a82f2060f', 'serial': '32a94a98-5e5d-4bde-89ad-576a82f2060f'}, 'attachment_id': 'fb54e966-5a96-4f57-a643-ea2ce93de876', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:11:40 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:11:40 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXBJdloE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:11:40 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:11:40 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:11:40 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[080cf4c1-5089-486a-b390-ebad73d6fe72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:11:40 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b00356a-372a-4ef2-99d4-a69d76ef0dce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f] added
Oct 30 11:11:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[30861390-cec1-4f23-9a73-610b70b8178d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e9bfac-e0e7-4a98-a1f1-027c5ca593fc]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXBJdloE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GXBJdloE" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d4baf5-d8d1-4290-af89-d0dbebe69871]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GXBJdloE'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[425e1cf1-b677-4319-bec6-b425cbd6106b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf471852-460d-4adc-bb21-114d69b747bb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)
Oct 30 11:11:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)
Oct 30 11:11:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.utils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b58973-9052-40a7-949e-fb8a7647aaf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc213f5-b784-4c6c-b1f7-8ff23a26f103]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260]
Oct 30 11:11:40 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260] successful.
Oct 30 11:11:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2e05a2-fffa-4c71-bf56-b2051bf9d489]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca058fb-95a6-4ec7-b2ad-bed44b6646b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5886441-a842-4a63-8d5f-3c96496da231]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)
Oct 30 11:11:40 user nova-compute[74278]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:11:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)
Oct 30 11:11:40 user nova-compute[74278]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:11:40 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff88ce20-3813-4cd1-81c1-1d33ebbdd166]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[392101c9-ca34-490b-b51b-3959fde2fc79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abc74f7-35b6-4a03-8a47-21d15ff9a2d9]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXBJdloE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:11:41 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[432d1f8f-59c4-40f8-9b56-fffd0b3834b0]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG os_brick.utils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Updating existing volume attachment record: e474bf7c-7b7a-410e-86d0-9a2bef6e770a {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:11:41 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:11:41 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8562MB free_disk=25.007625579833984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Applying migration context for instance a2cde4ee-e665-457a-b5f0-652a2c2b7f49 as it has an incoming, in-progress migration 7b43f3c8-e9c8-42e9-b4a6-d03d89f60e31. Migration status is post-migrating {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 30 11:11:41 user nova-compute[74278]: INFO nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating resource usage from migration 7b43f3c8-e9c8-42e9-b4a6-d03d89f60e31
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 453b1f71-8dc2-4f91-923a-dd183f2ec3ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Migration 7b43f3c8-e9c8-42e9-b4a6-d03d89f60e31 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a2cde4ee-e665-457a-b5f0-652a2c2b7f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance cbd67692-96bc-4770-b05e-744b4ecf834b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing inventories for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating ProviderTree inventory for provider ce405684-67ab-45d9-bc83-6af4903bfb15 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating inventory in ProviderTree for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 11:11:41 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing aggregate associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, aggregates: None {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing trait associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '26563356137363236', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563356137363236', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-238911529',display_name='tempest-ServerActionsTestOtherA-server-238911529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-238911529',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+yfE1fzC0NeFR+gspIaPJ/CcDdqYlrTD1/gMueYz50h0LQsw5TCBiSQS0P2divdfLo9Fj2hNvf4LMgeazslsUbDPOdzcoch9KTxV2Qpnb5QJ+Ahxn1Nm/kcqA+i5KG3A==',key_name='tempest-keypair-148099064',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:09:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-zwruvzc8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=a2cde4ee-e665-457a-b5f0-652a2c2b7f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-346429249-network", "vif_mac": "fa:16:3e:57:29:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-346429249-network", "vif_mac": "fa:16:3e:57:29:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:11:42 user nova-compute[74278]:   <uuid>a2cde4ee-e665-457a-b5f0-652a2c2b7f49</uuid>
Oct 30 11:11:42 user nova-compute[74278]:   <name>instance-00000026</name>
Oct 30 11:11:42 user nova-compute[74278]:   <memory>2097152</memory>
Oct 30 11:11:42 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:11:42 user nova-compute[74278]:   <metadata>
Oct 30 11:11:42 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:11:42 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:11:42 user nova-compute[74278]:       <nova:name>tempest-ServerActionsTestOtherA-server-238911529</nova:name>
Oct 30 11:11:42 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:11:40</nova:creationTime>
Oct 30 11:11:42 user nova-compute[74278]:       <nova:flavor name="m1.small">
Oct 30 11:11:42 user nova-compute[74278]:         <nova:memory>2048</nova:memory>
Oct 30 11:11:42 user nova-compute[74278]:         <nova:disk>20</nova:disk>
Oct 30 11:11:42 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:11:42 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:11:42 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:11:42 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:11:42 user nova-compute[74278]:       <nova:owner>
Oct 30 11:11:42 user nova-compute[74278]:         <nova:user uuid="1b9a38bd9c4e4717b9499ed404ed2d6d">tempest-ServerActionsTestOtherA-1217247754-project-member</nova:user>
Oct 30 11:11:42 user nova-compute[74278]:         <nova:project uuid="d8215346d10443799d5d450114b09386">tempest-ServerActionsTestOtherA-1217247754</nova:project>
Oct 30 11:11:42 user nova-compute[74278]:       </nova:owner>
Oct 30 11:11:42 user nova-compute[74278]:       <nova:ports>
Oct 30 11:11:42 user nova-compute[74278]:         <nova:port uuid="8de72719-56c4-4be2-b3f6-f4207ae8f395">
Oct 30 11:11:42 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 11:11:42 user nova-compute[74278]:         </nova:port>
Oct 30 11:11:42 user nova-compute[74278]:       </nova:ports>
Oct 30 11:11:42 user nova-compute[74278]:     </nova:instance>
Oct 30 11:11:42 user nova-compute[74278]:   </metadata>
Oct 30 11:11:42 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:11:42 user nova-compute[74278]:     <system>
Oct 30 11:11:42 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:11:42 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:11:42 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:11:42 user nova-compute[74278]:       <entry name="serial">a2cde4ee-e665-457a-b5f0-652a2c2b7f49</entry>
Oct 30 11:11:42 user nova-compute[74278]:       <entry name="uuid">a2cde4ee-e665-457a-b5f0-652a2c2b7f49</entry>
Oct 30 11:11:42 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:11:42 user nova-compute[74278]:     </system>
Oct 30 11:11:42 user nova-compute[74278]:   </sysinfo>
Oct 30 11:11:42 user nova-compute[74278]:   <os>
Oct 30 11:11:42 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:11:42 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:11:42 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:11:42 user nova-compute[74278]:   </os>
Oct 30 11:11:42 user nova-compute[74278]:   <features>
Oct 30 11:11:42 user nova-compute[74278]:     <acpi/>
Oct 30 11:11:42 user nova-compute[74278]:     <apic/>
Oct 30 11:11:42 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:11:42 user nova-compute[74278]:   </features>
Oct 30 11:11:42 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:11:42 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:11:42 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:11:42 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:11:42 user nova-compute[74278]:   </clock>
Oct 30 11:11:42 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:11:42 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:11:42 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:11:42 user nova-compute[74278]:   </cpu>
Oct 30 11:11:42 user nova-compute[74278]:   <devices>
Oct 30 11:11:42 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:11:42 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:11:42 user nova-compute[74278]:       <source dev="/dev/sdc"/>
Oct 30 11:11:42 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:11:42 user nova-compute[74278]:       <serial>32a94a98-5e5d-4bde-89ad-576a82f2060f</serial>
Oct 30 11:11:42 user nova-compute[74278]:     </disk>
Oct 30 11:11:42 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:11:42 user nova-compute[74278]:       <mac address="fa:16:3e:57:29:0b"/>
Oct 30 11:11:42 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:11:42 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:11:42 user nova-compute[74278]:       <target dev="tap8de72719-56"/>
Oct 30 11:11:42 user nova-compute[74278]:     </interface>
Oct 30 11:11:42 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:11:42 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/a2cde4ee-e665-457a-b5f0-652a2c2b7f49/console.log" append="off"/>
Oct 30 11:11:42 user nova-compute[74278]:     </serial>
Oct 30 11:11:42 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:11:42 user nova-compute[74278]:     <video>
Oct 30 11:11:42 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:11:42 user nova-compute[74278]:     </video>
Oct 30 11:11:42 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:11:42 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:11:42 user nova-compute[74278]:     </rng>
Oct 30 11:11:42 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:11:42 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:11:42 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:11:42 user nova-compute[74278]:     </memballoon>
Oct 30 11:11:42 user nova-compute[74278]:   </devices>
Oct 30 11:11:42 user nova-compute[74278]: </domain>
Oct 30 11:11:42 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-238911529',display_name='tempest-ServerActionsTestOtherA-server-238911529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-238911529',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+yfE1fzC0NeFR+gspIaPJ/CcDdqYlrTD1/gMueYz50h0LQsw5TCBiSQS0P2divdfLo9Fj2hNvf4LMgeazslsUbDPOdzcoch9KTxV2Qpnb5QJ+Ahxn1Nm/kcqA+i5KG3A==',key_name='tempest-keypair-148099064',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:09:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-zwruvzc8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=a2cde4ee-e665-457a-b5f0-652a2c2b7f49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-346429249-network", "vif_mac": "fa:16:3e:57:29:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-346429249-network", "vif_mac": "fa:16:3e:57:29:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG os_vif [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5e1e78c-c161-552e-a142-142a3362de4f', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8de72719-56, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8de72719-56, col_values=(('qos', UUID('79ee71fd-1002-4955-9186-cb1a101494e1')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8de72719-56, col_values=(('external_ids', {'iface-id': '8de72719-56c4-4be2-b3f6-f4207ae8f395', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:29:0b', 'vm-uuid': 'a2cde4ee-e665-457a-b5f0-652a2c2b7f49'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:42 user nova-compute[74278]: INFO os_vif [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56')
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] No VIF found with MAC fa:16:3e:57:29:0b, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:11:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.471s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-7e530b40-926a-47a6-b00f-494602416ac5 req-a99752ec-dab3-478e-99d3-741101bdc3b5 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received event network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7e530b40-926a-47a6-b00f-494602416ac5 req-a99752ec-dab3-478e-99d3-741101bdc3b5 service nova] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7e530b40-926a-47a6-b00f-494602416ac5 req-a99752ec-dab3-478e-99d3-741101bdc3b5 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7e530b40-926a-47a6-b00f-494602416ac5 req-a99752ec-dab3-478e-99d3-741101bdc3b5 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-7e530b40-926a-47a6-b00f-494602416ac5 req-a99752ec-dab3-478e-99d3-741101bdc3b5 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] No waiting events found dispatching network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:11:43 user nova-compute[74278]: WARNING nova.compute.manager [req-7e530b40-926a-47a6-b00f-494602416ac5 req-a99752ec-dab3-478e-99d3-741101bdc3b5 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received unexpected event network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 for instance with vm_state active and task_state resize_finish.
Oct 30 11:11:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:45 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:11:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:45 user nova-compute[74278]: DEBUG nova.compute.manager [req-11e0e8fd-83d4-4086-b45a-aa07daf1e324 req-b6384f56-6d80-44b8-86a1-030d064ee702 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received event network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:11:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-11e0e8fd-83d4-4086-b45a-aa07daf1e324 req-b6384f56-6d80-44b8-86a1-030d064ee702 service nova] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:11:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-11e0e8fd-83d4-4086-b45a-aa07daf1e324 req-b6384f56-6d80-44b8-86a1-030d064ee702 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:11:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-11e0e8fd-83d4-4086-b45a-aa07daf1e324 req-b6384f56-6d80-44b8-86a1-030d064ee702 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:11:45 user nova-compute[74278]: DEBUG nova.compute.manager [req-11e0e8fd-83d4-4086-b45a-aa07daf1e324 req-b6384f56-6d80-44b8-86a1-030d064ee702 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] No waiting events found dispatching network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:11:45 user nova-compute[74278]: WARNING nova.compute.manager [req-11e0e8fd-83d4-4086-b45a-aa07daf1e324 req-b6384f56-6d80-44b8-86a1-030d064ee702 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received unexpected event network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 for instance with vm_state active and task_state resize_finish.
Oct 30 11:11:45 user nova-compute[74278]: DEBUG nova.compute.manager [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:11:45 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Instance running successfully.
Oct 30 11:11:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Failed to set time: agent not configured {{(pid=74278) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 30 11:11:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2d8c34a1-ebe4-4e4f-93b7-02096346750e tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] finish_migration finished successfully. {{(pid=74278) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 30 11:11:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:50 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:11:50 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74278) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 11:11:51 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:11:51 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 11:11:51 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] There are 0 instances to clean {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 11:11:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:11:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:12:05 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Creating image(s)
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Ensure instance console log exists: /opt/stack/data/nova/instances/cbd67692-96bc-4770-b05e-744b4ecf834b/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Start _get_guest_xml network_info=[{"id": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "address": "fa:16:3e:78:54:3d", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ef729a-0b", "ovs_interfaceid": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzphVIti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cbd67692-96bc-4770-b05e-744b4ecf834b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a', 'serial': 'ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a'}, 'attachment_id': 'e474bf7c-7b7a-410e-86d0-9a2bef6e770a', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:12:05 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:12:05 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzphVIti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:12:05 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:12:05 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:12:05 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b207b12-6737-48e3-b9f8-47338693c5de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:12:05 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97d7ddb-b365-4326-8c91-fe76801fcb1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a] added
Oct 30 11:12:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c2f45d-266d-4f01-8070-7789b5dedc5d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6fa4c4-70f5-41f9-ab76-ca28bdd3a676]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QzphVIti {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QzphVIti" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04d86a4-28c9-4fd4-91f1-299dfa954e98]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QzphVIti'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e2e59e-b5a0-4d38-912b-0ff127d8902d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed5fa33-d3e3-4c04-816e-b58e55043d2e]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)
Oct 30 11:12:05 user nova-compute[74278]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:12:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)
Oct 30 11:12:05 user nova-compute[74278]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:12:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7a69e8-2c0c-45b1-8934-fe6891bd85db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a, portal: 172.16.0.220,3260]
Oct 30 11:12:05 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a, portal: 172.16.0.220,3260] successful.
Oct 30 11:12:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a5c76-8eb4-415f-8aaa-4ff86f25aa66]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0e5a96-6d2c-406c-9712-1cafcc0db9d6]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)
Oct 30 11:12:05 user nova-compute[74278]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:12:05 user nova-compute[74278]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)
Oct 30 11:12:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)
Oct 30 11:12:05 user nova-compute[74278]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:12:05 user nova-compute[74278]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)
Oct 30 11:12:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e648f8f8-74c1-4f5f-a691-76b29524d43f]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:05 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzphVIti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23139643437353661', 'path': '/dev/sdd'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139643437353661', 'path': '/dev/sdd'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-630769668',display_name='tempest-TestVolumeBootPattern-server-630769668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-630769668',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-wiu9y1ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:11:35Z,user_data=None,user_id='e921926b3790497fb9630088c501af82',uuid=cbd67692-96bc-4770-b05e-744b4ecf834b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "address": "fa:16:3e:78:54:3d", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ef729a-0b", "ovs_interfaceid": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "address": "fa:16:3e:78:54:3d", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ef729a-0b", "ovs_interfaceid": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ef729a-0b') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG nova.objects.instance [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lazy-loading 'pci_devices' on Instance uuid cbd67692-96bc-4770-b05e-744b4ecf834b {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:12:06 user nova-compute[74278]:   <uuid>cbd67692-96bc-4770-b05e-744b4ecf834b</uuid>
Oct 30 11:12:06 user nova-compute[74278]:   <name>instance-00000028</name>
Oct 30 11:12:06 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:12:06 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:12:06 user nova-compute[74278]:   <metadata>
Oct 30 11:12:06 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:12:06 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:12:06 user nova-compute[74278]:       <nova:name>tempest-TestVolumeBootPattern-server-630769668</nova:name>
Oct 30 11:12:06 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:12:05</nova:creationTime>
Oct 30 11:12:06 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:12:06 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:12:06 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:12:06 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:12:06 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:12:06 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:12:06 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:12:06 user nova-compute[74278]:       <nova:owner>
Oct 30 11:12:06 user nova-compute[74278]:         <nova:user uuid="e921926b3790497fb9630088c501af82">tempest-TestVolumeBootPattern-2008975673-project-member</nova:user>
Oct 30 11:12:06 user nova-compute[74278]:         <nova:project uuid="59235488214e4149a91d6c2d5a02dd21">tempest-TestVolumeBootPattern-2008975673</nova:project>
Oct 30 11:12:06 user nova-compute[74278]:       </nova:owner>
Oct 30 11:12:06 user nova-compute[74278]:       <nova:ports>
Oct 30 11:12:06 user nova-compute[74278]:         <nova:port uuid="c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a">
Oct 30 11:12:06 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 11:12:06 user nova-compute[74278]:         </nova:port>
Oct 30 11:12:06 user nova-compute[74278]:       </nova:ports>
Oct 30 11:12:06 user nova-compute[74278]:     </nova:instance>
Oct 30 11:12:06 user nova-compute[74278]:   </metadata>
Oct 30 11:12:06 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:12:06 user nova-compute[74278]:     <system>
Oct 30 11:12:06 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:12:06 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:12:06 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:12:06 user nova-compute[74278]:       <entry name="serial">cbd67692-96bc-4770-b05e-744b4ecf834b</entry>
Oct 30 11:12:06 user nova-compute[74278]:       <entry name="uuid">cbd67692-96bc-4770-b05e-744b4ecf834b</entry>
Oct 30 11:12:06 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:12:06 user nova-compute[74278]:     </system>
Oct 30 11:12:06 user nova-compute[74278]:   </sysinfo>
Oct 30 11:12:06 user nova-compute[74278]:   <os>
Oct 30 11:12:06 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:12:06 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:12:06 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:12:06 user nova-compute[74278]:   </os>
Oct 30 11:12:06 user nova-compute[74278]:   <features>
Oct 30 11:12:06 user nova-compute[74278]:     <acpi/>
Oct 30 11:12:06 user nova-compute[74278]:     <apic/>
Oct 30 11:12:06 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:12:06 user nova-compute[74278]:   </features>
Oct 30 11:12:06 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:12:06 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:12:06 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:12:06 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:12:06 user nova-compute[74278]:   </clock>
Oct 30 11:12:06 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:12:06 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:12:06 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:12:06 user nova-compute[74278]:   </cpu>
Oct 30 11:12:06 user nova-compute[74278]:   <devices>
Oct 30 11:12:06 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:12:06 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:12:06 user nova-compute[74278]:       <source dev="/dev/sdd"/>
Oct 30 11:12:06 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:12:06 user nova-compute[74278]:       <serial>ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a</serial>
Oct 30 11:12:06 user nova-compute[74278]:     </disk>
Oct 30 11:12:06 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:12:06 user nova-compute[74278]:       <mac address="fa:16:3e:78:54:3d"/>
Oct 30 11:12:06 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:12:06 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:12:06 user nova-compute[74278]:       <target dev="tapc5ef729a-0b"/>
Oct 30 11:12:06 user nova-compute[74278]:     </interface>
Oct 30 11:12:06 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:12:06 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/cbd67692-96bc-4770-b05e-744b4ecf834b/console.log" append="off"/>
Oct 30 11:12:06 user nova-compute[74278]:     </serial>
Oct 30 11:12:06 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:12:06 user nova-compute[74278]:     <video>
Oct 30 11:12:06 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:12:06 user nova-compute[74278]:     </video>
Oct 30 11:12:06 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:12:06 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:12:06 user nova-compute[74278]:     </rng>
Oct 30 11:12:06 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:12:06 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:12:06 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:12:06 user nova-compute[74278]:     </memballoon>
Oct 30 11:12:06 user nova-compute[74278]:   </devices>
Oct 30 11:12:06 user nova-compute[74278]: </domain>
Oct 30 11:12:06 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-630769668',display_name='tempest-TestVolumeBootPattern-server-630769668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-630769668',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-wiu9y1ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:11:35Z,user_data=None,user_id='e921926b3790497fb9630088c501af82',uuid=cbd67692-96bc-4770-b05e-744b4ecf834b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "address": "fa:16:3e:78:54:3d", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ef729a-0b", "ovs_interfaceid": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "address": "fa:16:3e:78:54:3d", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ef729a-0b", "ovs_interfaceid": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ef729a-0b') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG os_vif [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ef729a-0b') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5361f5b3-4f91-56ea-8332-45674778025d', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5ef729a-0b, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5ef729a-0b, col_values=(('qos', UUID('dfb4034a-878a-4564-bd01-4e0815a51f03')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5ef729a-0b, col_values=(('external_ids', {'iface-id': 'c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:54:3d', 'vm-uuid': 'cbd67692-96bc-4770-b05e-744b4ecf834b'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:12:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:12:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:07 user nova-compute[74278]: INFO os_vif [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ef729a-0b')
Oct 30 11:12:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:12:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] No VIF found with MAC fa:16:3e:78:54:3d, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:12:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-f5336e19-8a11-4fd4-b59d-7a2b999681c0 req-6d34a6d2-b763-43c6-ad4f-ec54b17a8893 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Received event network-vif-plugged-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:12:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f5336e19-8a11-4fd4-b59d-7a2b999681c0 req-6d34a6d2-b763-43c6-ad4f-ec54b17a8893 service nova] Acquiring lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f5336e19-8a11-4fd4-b59d-7a2b999681c0 req-6d34a6d2-b763-43c6-ad4f-ec54b17a8893 service nova] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f5336e19-8a11-4fd4-b59d-7a2b999681c0 req-6d34a6d2-b763-43c6-ad4f-ec54b17a8893 service nova] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-f5336e19-8a11-4fd4-b59d-7a2b999681c0 req-6d34a6d2-b763-43c6-ad4f-ec54b17a8893 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] No waiting events found dispatching network-vif-plugged-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:12:08 user nova-compute[74278]: WARNING nova.compute.manager [req-f5336e19-8a11-4fd4-b59d-7a2b999681c0 req-6d34a6d2-b763-43c6-ad4f-ec54b17a8893 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Received unexpected event network-vif-plugged-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a for instance with vm_state building and task_state spawning.
Oct 30 11:12:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-0bdbd52f-e19b-4d0f-b6c3-ffa167e9b81d req-147f9fd0-835c-4158-9ecb-c68b2db8c67f service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Received event network-vif-plugged-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:12:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0bdbd52f-e19b-4d0f-b6c3-ffa167e9b81d req-147f9fd0-835c-4158-9ecb-c68b2db8c67f service nova] Acquiring lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0bdbd52f-e19b-4d0f-b6c3-ffa167e9b81d req-147f9fd0-835c-4158-9ecb-c68b2db8c67f service nova] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0bdbd52f-e19b-4d0f-b6c3-ffa167e9b81d req-147f9fd0-835c-4158-9ecb-c68b2db8c67f service nova] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-0bdbd52f-e19b-4d0f-b6c3-ffa167e9b81d req-147f9fd0-835c-4158-9ecb-c68b2db8c67f service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] No waiting events found dispatching network-vif-plugged-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:12:10 user nova-compute[74278]: WARNING nova.compute.manager [req-0bdbd52f-e19b-4d0f-b6c3-ffa167e9b81d req-147f9fd0-835c-4158-9ecb-c68b2db8c67f service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Received unexpected event network-vif-plugged-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a for instance with vm_state building and task_state spawning.
Oct 30 11:12:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "290c5792-7212-4a44-bf02-b51133a118ed" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.004s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:10 user nova-compute[74278]: INFO nova.compute.manager [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Unshelving
Oct 30 11:12:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:10 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'pci_requests' on Instance uuid 290c5792-7212-4a44-bf02-b51133a118ed {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:12:10 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'numa_topology' on Instance uuid 290c5792-7212-4a44-bf02-b51133a118ed {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:12:11 user nova-compute[74278]: INFO nova.compute.claims [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Claim successful on node user
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:12:11 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Instance spawned successfully.
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:12:11 user nova-compute[74278]: INFO nova.compute.manager [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Took 5.62 seconds to spawn the instance on the hypervisor.
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:12:11 user nova-compute[74278]: INFO nova.compute.manager [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Took 36.66 seconds to build instance.
Oct 30 11:12:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b3fdb89d-a3e3-475d-b296-f9967b66aeb3 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.811s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:12:11 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:12:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:11 user nova-compute[74278]: INFO nova.network.neutron [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updating port 8eba06a8-c7a5-478f-8924-bc26b35789c7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 30 11:12:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:12:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquired lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:12:12 user nova-compute[74278]: DEBUG nova.network.neutron [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-f50f40f6-49b1-4d57-9557-9e204e1eda3b req-55fdfd43-4c5b-4158-8339-3939f3046326 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-changed-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-f50f40f6-49b1-4d57-9557-9e204e1eda3b req-55fdfd43-4c5b-4158-8339-3939f3046326 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Refreshing instance network info cache due to event network-changed-8eba06a8-c7a5-478f-8924-bc26b35789c7. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f50f40f6-49b1-4d57-9557-9e204e1eda3b req-55fdfd43-4c5b-4158-8339-3939f3046326 service nova] Acquiring lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG nova.network.neutron [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updating instance_info_cache with network_info: [{"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Releasing lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:12:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Creating image(s)
Oct 30 11:12:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "/opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "/opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "/opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'trusted_certs' on Instance uuid 290c5792-7212-4a44-bf02-b51133a118ed {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f50f40f6-49b1-4d57-9557-9e204e1eda3b req-55fdfd43-4c5b-4158-8339-3939f3046326 service nova] Acquired lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG nova.network.neutron [req-f50f40f6-49b1-4d57-9557-9e204e1eda3b req-55fdfd43-4c5b-4158-8339-3939f3046326 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Refreshing network info cache for port 8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG nova.objects.base [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Object Instance<290c5792-7212-4a44-bf02-b51133a118ed> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "9c3c13ce78154de555b02edbaad5a599101b67d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "9c3c13ce78154de555b02edbaad5a599101b67d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9.part --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:14 user nova-compute[74278]: DEBUG nova.virt.images [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] 136f4e68-cd15-4f1b-9bbd-87562b7b0631 was qcow2, converting to raw {{(pid=74278) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 11:12:14 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 11:12:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9.part /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9.converted {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9.part /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9.converted" returned: 0 in 0.233s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9.converted --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-f50f40f6-49b1-4d57-9557-9e204e1eda3b req-55fdfd43-4c5b-4158-8339-3939f3046326 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updated VIF entry in instance network info cache for port 8eba06a8-c7a5-478f-8924-bc26b35789c7. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-f50f40f6-49b1-4d57-9557-9e204e1eda3b req-55fdfd43-4c5b-4158-8339-3939f3046326 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updating instance_info_cache with network_info: [{"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f50f40f6-49b1-4d57-9557-9e204e1eda3b req-55fdfd43-4c5b-4158-8339-3939f3046326 service nova] Releasing lock "refresh_cache-290c5792-7212-4a44-bf02-b51133a118ed" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "9c3c13ce78154de555b02edbaad5a599101b67d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.824s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9 --force-share --output=json" returned: 0 in 0.188s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "9c3c13ce78154de555b02edbaad5a599101b67d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "9c3c13ce78154de555b02edbaad5a599101b67d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9 --force-share --output=json" returned: 0 in 0.209s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9,backing_fmt=raw /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9,backing_fmt=raw /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk 1073741824" returned: 0 in 0.053s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "9c3c13ce78154de555b02edbaad5a599101b67d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9 --force-share --output=json" returned: 0 in 0.191s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:16 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'migration_context' on Instance uuid 290c5792-7212-4a44-bf02-b51133a118ed {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:12:16 user nova-compute[74278]: DEBUG nova.objects.base [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Object Instance<290c5792-7212-4a44-bf02-b51133a118ed> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:12:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Rebasing disk image.
Oct 30 11:12:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 -F raw /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 -F raw /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk" returned: 0 in 2.443s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Ensure instance console log exists: /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Start _get_guest_xml network_info=[{"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0a5e5f9423bbf538ed1743b7aec9c832',container_format='bare',created_at=2023-10-30T11:10:17Z,direct_url=<?>,disk_format='qcow2',id=136f4e68-cd15-4f1b-9bbd-87562b7b0631,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1860907579-shelved',owner='31dd01e2d9be4a0b96e94493f8eb43d7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T11:10:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:12:18 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:12:18 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0a5e5f9423bbf538ed1743b7aec9c832',container_format='bare',created_at=2023-10-30T11:10:17Z,direct_url=<?>,disk_format='qcow2',id=136f4e68-cd15-4f1b-9bbd-87562b7b0631,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1860907579-shelved',owner='31dd01e2d9be4a0b96e94493f8eb43d7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T11:10:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'vcpu_model' on Instance uuid 290c5792-7212-4a44-bf02-b51133a118ed {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.objects.base [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Object Instance<290c5792-7212-4a44-bf02-b51133a118ed> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1860907579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1860907579',id=35,image_ref='136f4e68-cd15-4f1b-9bbd-87562b7b0631',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1069109495',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='31dd01e2d9be4a0b96e94493f8eb43d7',ramdisk_id='',reservation_id='r-zqi01yl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2142703659',owner_user_name='tempest-AttachVolumeShelveTestJSON-2142703659-project-member',shelved_at='2023-10-30T11:10:22.026648',shelved_host='user',shelved_image_id='136f4e68-cd15-4f1b-9bbd-87562b7b0631'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584de218cec24240a91845deca515efa',uuid=290c5792-7212-4a44-bf02-b51133a118ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converting VIF {"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.objects.instance [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'pci_devices' on Instance uuid 290c5792-7212-4a44-bf02-b51133a118ed {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.objects.base [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Object Instance<290c5792-7212-4a44-bf02-b51133a118ed> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:12:18 user nova-compute[74278]:   <uuid>290c5792-7212-4a44-bf02-b51133a118ed</uuid>
Oct 30 11:12:18 user nova-compute[74278]:   <name>instance-00000023</name>
Oct 30 11:12:18 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:12:18 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:12:18 user nova-compute[74278]:   <metadata>
Oct 30 11:12:18 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:12:18 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:12:18 user nova-compute[74278]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1860907579</nova:name>
Oct 30 11:12:18 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:12:18</nova:creationTime>
Oct 30 11:12:18 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:12:18 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:12:18 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:12:18 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:12:18 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:12:18 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:12:18 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:12:18 user nova-compute[74278]:       <nova:owner>
Oct 30 11:12:18 user nova-compute[74278]:         <nova:user uuid="584de218cec24240a91845deca515efa">tempest-AttachVolumeShelveTestJSON-2142703659-project-member</nova:user>
Oct 30 11:12:18 user nova-compute[74278]:         <nova:project uuid="31dd01e2d9be4a0b96e94493f8eb43d7">tempest-AttachVolumeShelveTestJSON-2142703659</nova:project>
Oct 30 11:12:18 user nova-compute[74278]:       </nova:owner>
Oct 30 11:12:18 user nova-compute[74278]:       <nova:root type="image" uuid="136f4e68-cd15-4f1b-9bbd-87562b7b0631"/>
Oct 30 11:12:18 user nova-compute[74278]:       <nova:ports>
Oct 30 11:12:18 user nova-compute[74278]:         <nova:port uuid="8eba06a8-c7a5-478f-8924-bc26b35789c7">
Oct 30 11:12:18 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 11:12:18 user nova-compute[74278]:         </nova:port>
Oct 30 11:12:18 user nova-compute[74278]:       </nova:ports>
Oct 30 11:12:18 user nova-compute[74278]:     </nova:instance>
Oct 30 11:12:18 user nova-compute[74278]:   </metadata>
Oct 30 11:12:18 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:12:18 user nova-compute[74278]:     <system>
Oct 30 11:12:18 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:12:18 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:12:18 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:12:18 user nova-compute[74278]:       <entry name="serial">290c5792-7212-4a44-bf02-b51133a118ed</entry>
Oct 30 11:12:18 user nova-compute[74278]:       <entry name="uuid">290c5792-7212-4a44-bf02-b51133a118ed</entry>
Oct 30 11:12:18 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:12:18 user nova-compute[74278]:     </system>
Oct 30 11:12:18 user nova-compute[74278]:   </sysinfo>
Oct 30 11:12:18 user nova-compute[74278]:   <os>
Oct 30 11:12:18 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:12:18 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:12:18 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:12:18 user nova-compute[74278]:   </os>
Oct 30 11:12:18 user nova-compute[74278]:   <features>
Oct 30 11:12:18 user nova-compute[74278]:     <acpi/>
Oct 30 11:12:18 user nova-compute[74278]:     <apic/>
Oct 30 11:12:18 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:12:18 user nova-compute[74278]:   </features>
Oct 30 11:12:18 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:12:18 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:12:18 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:12:18 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:12:18 user nova-compute[74278]:   </clock>
Oct 30 11:12:18 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:12:18 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:12:18 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:12:18 user nova-compute[74278]:   </cpu>
Oct 30 11:12:18 user nova-compute[74278]:   <devices>
Oct 30 11:12:18 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:12:18 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:12:18 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk"/>
Oct 30 11:12:18 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:12:18 user nova-compute[74278]:     </disk>
Oct 30 11:12:18 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:12:18 user nova-compute[74278]:       <mac address="fa:16:3e:ca:66:3b"/>
Oct 30 11:12:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:12:18 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:12:18 user nova-compute[74278]:       <target dev="tap8eba06a8-c7"/>
Oct 30 11:12:18 user nova-compute[74278]:     </interface>
Oct 30 11:12:18 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:12:18 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/console.log" append="off"/>
Oct 30 11:12:18 user nova-compute[74278]:     </serial>
Oct 30 11:12:18 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:12:18 user nova-compute[74278]:     <video>
Oct 30 11:12:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:12:18 user nova-compute[74278]:     </video>
Oct 30 11:12:18 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:12:18 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:12:18 user nova-compute[74278]:     </rng>
Oct 30 11:12:18 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:12:18 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:12:18 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:12:18 user nova-compute[74278]:     </memballoon>
Oct 30 11:12:18 user nova-compute[74278]:   </devices>
Oct 30 11:12:18 user nova-compute[74278]: </domain>
Oct 30 11:12:18 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1860907579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1860907579',id=35,image_ref='136f4e68-cd15-4f1b-9bbd-87562b7b0631',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1069109495',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='31dd01e2d9be4a0b96e94493f8eb43d7',ramdisk_id='',reservation_id='r-zqi01yl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2142703659',owner_user_name='tempest-AttachVolumeShelveTestJSON-2142703659-project-member',shelved_at='2023-10-30T11:10:22.026648',shelved_host='user',shelved_image_id='136f4e68-cd15-4f1b-9bbd-87562b7b0631'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584de218cec24240a91845deca515efa',uuid=290c5792-7212-4a44-bf02-b51133a118ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converting VIF {"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG os_vif [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1787521f-8372-5a3f-abfa-a508544673ea', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8eba06a8-c7, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8eba06a8-c7, col_values=(('qos', UUID('03e1b843-53e5-4ccb-b985-65d89e28b7b8')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8eba06a8-c7, col_values=(('external_ids', {'iface-id': '8eba06a8-c7a5-478f-8924-bc26b35789c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:66:3b', 'vm-uuid': '290c5792-7212-4a44-bf02-b51133a118ed'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:12:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:18 user nova-compute[74278]: INFO os_vif [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7')
Oct 30 11:12:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:12:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] No VIF found with MAC fa:16:3e:ca:66:3b, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:12:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-4d80c34f-c0fe-4a68-ba77-73081b25ddac req-6b9c6824-9f03-4295-a351-d33de10a5ae1 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:12:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4d80c34f-c0fe-4a68-ba77-73081b25ddac req-6b9c6824-9f03-4295-a351-d33de10a5ae1 service nova] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4d80c34f-c0fe-4a68-ba77-73081b25ddac req-6b9c6824-9f03-4295-a351-d33de10a5ae1 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4d80c34f-c0fe-4a68-ba77-73081b25ddac req-6b9c6824-9f03-4295-a351-d33de10a5ae1 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-4d80c34f-c0fe-4a68-ba77-73081b25ddac req-6b9c6824-9f03-4295-a351-d33de10a5ae1 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] No waiting events found dispatching network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:12:21 user nova-compute[74278]: WARNING nova.compute.manager [req-4d80c34f-c0fe-4a68-ba77-73081b25ddac req-6b9c6824-9f03-4295-a351-d33de10a5ae1 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received unexpected event network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 11:12:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:12:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:12:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Instance spawned successfully.
Oct 30 11:12:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:12:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3858146-7973-4ced-a7f6-ea29919bd87c req-d03bdec1-b99a-4946-8eb2-3344b7412a36 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:12:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3858146-7973-4ced-a7f6-ea29919bd87c req-d03bdec1-b99a-4946-8eb2-3344b7412a36 service nova] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3858146-7973-4ced-a7f6-ea29919bd87c req-d03bdec1-b99a-4946-8eb2-3344b7412a36 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b3858146-7973-4ced-a7f6-ea29919bd87c req-d03bdec1-b99a-4946-8eb2-3344b7412a36 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-b3858146-7973-4ced-a7f6-ea29919bd87c req-d03bdec1-b99a-4946-8eb2-3344b7412a36 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] No waiting events found dispatching network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:12:23 user nova-compute[74278]: WARNING nova.compute.manager [req-b3858146-7973-4ced-a7f6-ea29919bd87c req-d03bdec1-b99a-4946-8eb2-3344b7412a36 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received unexpected event network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 11:12:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-eace8410-1bfb-40f0-a247-99234ccaebe4 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "290c5792-7212-4a44-bf02-b51133a118ed" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.316s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:31 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:12:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:35 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:12:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:12:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:12:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 30 11:12:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:12:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:12:37 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:12:37 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating instance_info_cache with network_info: [{"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:12:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:12:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:12:38 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:12:38 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:12:38 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:12:38 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:12:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:39 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:12:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:12:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:12:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:12:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:12:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:12:42 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:12:42 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8173MB free_disk=24.962482452392578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Applying migration context for instance a2cde4ee-e665-457a-b5f0-652a2c2b7f49 as it has an incoming, in-progress migration 7b43f3c8-e9c8-42e9-b4a6-d03d89f60e31. Migration status is finished {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 30 11:12:42 user nova-compute[74278]: INFO nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating resource usage from migration 7b43f3c8-e9c8-42e9-b4a6-d03d89f60e31
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 453b1f71-8dc2-4f91-923a-dd183f2ec3ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Migration 7b43f3c8-e9c8-42e9-b4a6-d03d89f60e31 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a2cde4ee-e665-457a-b5f0-652a2c2b7f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance cbd67692-96bc-4770-b05e-744b4ecf834b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 290c5792-7212-4a44-bf02-b51133a118ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:12:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:12:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:46 user nova-compute[74278]: INFO nova.compute.manager [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Detaching volume 9d238f47-2363-4884-a95e-0cdf9ab7c7e7
Oct 30 11:12:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:12:46 user nova-compute[74278]: INFO nova.virt.block_device [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Attempting to driver detach volume 9d238f47-2363-4884-a95e-0cdf9ab7c7e7 from mountpoint /dev/vdb
Oct 30 11:12:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Attempting to detach device vdb from instance 453b1f71-8dc2-4f91-923a-dd183f2ec3ea from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:12:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:12:46 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:12:46 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:12:46 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:12:46 user nova-compute[74278]:   <serial>9d238f47-2363-4884-a95e-0cdf9ab7c7e7</serial>
Oct 30 11:12:46 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:12:46 user nova-compute[74278]: </disk>
Oct 30 11:12:46 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:12:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:46 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Successfully detached device vdb from instance 453b1f71-8dc2-4f91-923a-dd183f2ec3ea from the persistent domain config.
Oct 30 11:12:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 453b1f71-8dc2-4f91-923a-dd183f2ec3ea from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:12:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:12:46 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:12:46 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:12:46 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:12:46 user nova-compute[74278]:   <serial>9d238f47-2363-4884-a95e-0cdf9ab7c7e7</serial>
Oct 30 11:12:46 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:12:46 user nova-compute[74278]: </disk>
Oct 30 11:12:46 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:12:47 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 453b1f71-8dc2-4f91-923a-dd183f2ec3ea {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:12:47 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:12:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:12:52 user nova-compute[74278]: INFO nova.compute.manager [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Unshelving
Oct 30 11:12:52 user nova-compute[74278]: INFO nova.virt.block_device [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Booting with volume 9326cea9-3b72-4121-94cc-f2e6246f1108 at /dev/vda
Oct 30 11:12:52 user nova-compute[74278]: DEBUG os_brick.utils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[213eb029-dc7d-44d6-a401-474795b7096f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4e7e4c-e351-4bd8-bc0c-fb79adeb23a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1ba380-793b-4adc-b8bc-e86514e1f308]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b006ecc-dc29-470b-b901-350412078fe7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:12:52 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:12:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe13dca-b32f-4332-80b5-50c42fa3a9ce]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG os_brick.utils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:12:52 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating existing volume attachment record: 742ecd93-1069-4d00-aec6-e8b203ecd5bf {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:12:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:12:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Going to confirm migration 2 {{(pid=74278) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 30 11:13:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:13:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquired lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:13:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:13:06 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lazy-loading 'info_cache' on Instance uuid a2cde4ee-e665-457a-b5f0-652a2c2b7f49 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:13:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 453b1f71-8dc2-4f91-923a-dd183f2ec3ea is timed out.
Oct 30 11:13:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Successfully detached device vdb from instance 453b1f71-8dc2-4f91-923a-dd183f2ec3ea from the live domain config.
Oct 30 11:13:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbhCOfaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:13:07 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[592eec26-a0c8-4859-a43a-e6bbc465f604]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:13:07 user nova-compute[74278]: No targets found.
Oct 30 11:13:07 user nova-compute[74278]: iSNS:
Oct 30 11:13:07 user nova-compute[74278]: No targets found.
Oct 30 11:13:07 user nova-compute[74278]: STATIC:
Oct 30 11:13:07 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f
Oct 30 11:13:07 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:13:07 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:13:07 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7
Oct 30 11:13:07 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:13:07 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:13:07 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a
Oct 30 11:13:07 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:13:07 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:13:07 user nova-compute[74278]: FIRMWARE:
Oct 30 11:13:07 user nova-compute[74278]: No targets found.
Oct 30 11:13:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:13:07 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:13:07 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[519918fe-9e9f-4119-bb69-05dfc2347070]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[603dfce6-5f9d-4e39-8108-d8458a12996d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)
Oct 30 11:13:07 user nova-compute[74278]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:13:07 user nova-compute[74278]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)
Oct 30 11:13:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 (non-flash)
Oct 30 11:13:07 user nova-compute[74278]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:13:07 user nova-compute[74278]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)
Oct 30 11:13:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c3ab400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba264f4f-4dd4-4010-bbe5-bb608d0119e7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG nova.network.neutron [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating instance_info_cache with network_info: [{"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6690833b-579c-4e1b-a01c-0a3ea39d6c31]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Releasing lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lazy-loading 'migration_context' on Instance uuid a2cde4ee-e665-457a-b5f0-652a2c2b7f49 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG nova.objects.base [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Object Instance<a2cde4ee-e665-457a-b5f0-652a2c2b7f49> lazy-loaded attributes: info_cache,migration_context {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[522454d6-2239-40d0-b49d-d62a5097b10f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3f05a6-818c-46c6-8455-c55e058a0489]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfc599b-d67e-4c1f-a502-17ce3f9508ef]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4f86ef-2412-4f25-82b4-39e35ef319e2]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7, portal: 172.16.0.220,3260]
Oct 30 11:13:07 user nova-compute[74278]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7, portal: 172.16.0.220,3260] successful.
Oct 30 11:13:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a67da-e992-40df-a653-8b599d475e6d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] <== disconnect_volume: return (338ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.332s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:07 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Deleted allocation for migration 7b43f3c8-e9c8-42e9-b4a6-d03d89f60e31
Oct 30 11:13:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8231ef74-ffa9-467c-b0bf-12ac7fa4624c tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.354s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lazy-loading 'flavor' on Instance uuid 453b1f71-8dc2-4f91-923a-dd183f2ec3ea {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9afc0566-84a9-4cd0-a201-45c95a1fab05 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.924s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.793s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:08 user nova-compute[74278]: INFO nova.compute.manager [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Terminating instance
Oct 30 11:13:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-95df06f0-e89b-4978-9bfd-faa1a2a092f3 req-607f73e4-a9c6-452e-805d-70937c586099 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Received event network-vif-unplugged-63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-95df06f0-e89b-4978-9bfd-faa1a2a092f3 req-607f73e4-a9c6-452e-805d-70937c586099 service nova] Acquiring lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-95df06f0-e89b-4978-9bfd-faa1a2a092f3 req-607f73e4-a9c6-452e-805d-70937c586099 service nova] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-95df06f0-e89b-4978-9bfd-faa1a2a092f3 req-607f73e4-a9c6-452e-805d-70937c586099 service nova] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-95df06f0-e89b-4978-9bfd-faa1a2a092f3 req-607f73e4-a9c6-452e-805d-70937c586099 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] No waiting events found dispatching network-vif-unplugged-63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-95df06f0-e89b-4978-9bfd-faa1a2a092f3 req-607f73e4-a9c6-452e-805d-70937c586099 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Received event network-vif-unplugged-63cb19f9-b71e-4400-9c40-e1108880fb85 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:13:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:09 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Instance destroyed successfully.
Oct 30 11:13:09 user nova-compute[74278]: DEBUG nova.objects.instance [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lazy-loading 'resources' on Instance uuid 453b1f71-8dc2-4f91-923a-dd183f2ec3ea {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1256415203',display_name='tempest-VolumesSnapshotTestJSON-instance-1256415203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1256415203',id=39,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJVwC/7MaUsvA47JXf5/RW1Oa9q8gzWIlYzlDZyU3pHPcw8vCFkTLCZzR8ViGCRQHSLJ3xeoQc2hXnJylwus1qPb6wqT9VbdjwSet9R+rDdaM5SclsCEPmGi5XaFaITVg==',key_name='tempest-keypair-58501289',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:09:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59ee9b3a0343474183d1e12dcef41703',ramdisk_id='',reservation_id='r-gj08lp54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-24712219',owner_user_name='tempest-VolumesSnapshotTestJSON-24712219-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:09:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffaf2383261d4cc1a6d7b304f515914b',uuid=453b1f71-8dc2-4f91-923a-dd183f2ec3ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63cb19f9-b71e-4400-9c40-e1108880fb85", "address": "fa:16:3e:36:67:d4", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63cb19f9-b7", "ovs_interfaceid": "63cb19f9-b71e-4400-9c40-e1108880fb85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Converting VIF {"id": "63cb19f9-b71e-4400-9c40-e1108880fb85", "address": "fa:16:3e:36:67:d4", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63cb19f9-b7", "ovs_interfaceid": "63cb19f9-b71e-4400-9c40-e1108880fb85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:67:d4,bridge_name='br-int',has_traffic_filtering=True,id=63cb19f9-b71e-4400-9c40-e1108880fb85,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63cb19f9-b7') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_vif [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:67:d4,bridge_name='br-int',has_traffic_filtering=True,id=63cb19f9-b71e-4400-9c40-e1108880fb85,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63cb19f9-b7') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63cb19f9-b7, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64019b8b-bb4e-4a84-b577-e65d18377b33) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:13:09 user nova-compute[74278]: INFO os_vif [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:67:d4,bridge_name='br-int',has_traffic_filtering=True,id=63cb19f9-b71e-4400-9c40-e1108880fb85,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63cb19f9-b7')
Oct 30 11:13:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MbhCOfaE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:13:09 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b565ca46-238f-4e55-83cf-1ef48f0c3334]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:13:09 user nova-compute[74278]: No targets found.
Oct 30 11:13:09 user nova-compute[74278]: iSNS:
Oct 30 11:13:09 user nova-compute[74278]: No targets found.
Oct 30 11:13:09 user nova-compute[74278]: STATIC:
Oct 30 11:13:09 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f
Oct 30 11:13:09 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:13:09 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:13:09 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a
Oct 30 11:13:09 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:13:09 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:13:09 user nova-compute[74278]: FIRMWARE:
Oct 30 11:13:09 user nova-compute[74278]: No targets found.
Oct 30 11:13:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:13:09 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:13:09 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d238f47-2363-4884-a95e-0cdf9ab7c7e7', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a99487d-2116-4257-967e-8055eadfb342]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccc5554-fc70-479a-aa41-33f35bda2f10]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:13:09 user nova-compute[74278]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)
Oct 30 11:13:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:13:09 user nova-compute[74278]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)
Oct 30 11:13:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c75d990>, {}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Disconnecting from: [] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] <== disconnect_volume: return (82ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:13:09 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Deleting instance files /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea_del
Oct 30 11:13:09 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Deletion of /opt/stack/data/nova/instances/453b1f71-8dc2-4f91-923a-dd183f2ec3ea_del complete
Oct 30 11:13:09 user nova-compute[74278]: INFO nova.compute.manager [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 30 11:13:09 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:13:09 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:13:10 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:13:10 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Took 1.08 seconds to deallocate network for instance.
Oct 30 11:13:10 user nova-compute[74278]: WARNING nova.volume.cinder [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Attachment 3d14b16c-2bb2-4042-ab86-5c75ae0cac98 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3d14b16c-2bb2-4042-ab86-5c75ae0cac98. (HTTP 404) (Request-ID: req-112bcb3b-6bf2-4716-a0fd-c0c13d284c86)
Oct 30 11:13:10 user nova-compute[74278]: INFO nova.compute.manager [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Took 0.03 seconds to detach 1 volumes for instance.
Oct 30 11:13:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-e4f8689d-0774-44a1-b335-908694fa4e58 req-19e838e7-cfc8-41b8-8084-6a7510d0b8f0 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Received event network-vif-deleted-63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:13:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:10 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:13:10 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:13:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:10 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Deleted allocations for instance 453b1f71-8dc2-4f91-923a-dd183f2ec3ea
Oct 30 11:13:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-13f41aaf-f3f5-4c61-b682-1d1dfe5e74dc tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.645s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-a53a4370-3671-4610-9c0d-2109246eb9f8 req-a4d20d2b-fa93-4886-a11d-408dc64c2641 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Received event network-vif-plugged-63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:13:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a53a4370-3671-4610-9c0d-2109246eb9f8 req-a4d20d2b-fa93-4886-a11d-408dc64c2641 service nova] Acquiring lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a53a4370-3671-4610-9c0d-2109246eb9f8 req-a4d20d2b-fa93-4886-a11d-408dc64c2641 service nova] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a53a4370-3671-4610-9c0d-2109246eb9f8 req-a4d20d2b-fa93-4886-a11d-408dc64c2641 service nova] Lock "453b1f71-8dc2-4f91-923a-dd183f2ec3ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-a53a4370-3671-4610-9c0d-2109246eb9f8 req-a4d20d2b-fa93-4886-a11d-408dc64c2641 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] No waiting events found dispatching network-vif-plugged-63cb19f9-b71e-4400-9c40-e1108880fb85 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:13:11 user nova-compute[74278]: WARNING nova.compute.manager [req-a53a4370-3671-4610-9c0d-2109246eb9f8 req-a4d20d2b-fa93-4886-a11d-408dc64c2641 service nova] [instance: 453b1f71-8dc2-4f91-923a-dd183f2ec3ea] Received unexpected event network-vif-plugged-63cb19f9-b71e-4400-9c40-e1108880fb85 for instance with vm_state deleted and task_state None.
Oct 30 11:13:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:12 user nova-compute[74278]: DEBUG nova.objects.instance [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lazy-loading 'pci_requests' on Instance uuid 0274d8c3-6a83-4959-85a6-4b8168a43df0 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:13:12 user nova-compute[74278]: DEBUG nova.objects.instance [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lazy-loading 'numa_topology' on Instance uuid 0274d8c3-6a83-4959-85a6-4b8168a43df0 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:13:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:13:12 user nova-compute[74278]: INFO nova.compute.claims [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Claim successful on node user
Oct 30 11:13:12 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:13:12 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:13:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:13 user nova-compute[74278]: INFO nova.network.neutron [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating port 1491bcc7-6199-4857-a8b0-ad1efc591df5 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 30 11:13:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:13:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquired lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:13:13 user nova-compute[74278]: DEBUG nova.network.neutron [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:13:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-27c2a120-bf41-43cf-adb4-fe6856191007 req-5836f485-1fe4-427b-9c3d-375910f4d0a3 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-changed-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:13:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-27c2a120-bf41-43cf-adb4-fe6856191007 req-5836f485-1fe4-427b-9c3d-375910f4d0a3 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Refreshing instance network info cache due to event network-changed-1491bcc7-6199-4857-a8b0-ad1efc591df5. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:13:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-27c2a120-bf41-43cf-adb4-fe6856191007 req-5836f485-1fe4-427b-9c3d-375910f4d0a3 service nova] Acquiring lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating instance_info_cache with network_info: [{"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Releasing lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:13:14 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Creating image(s)
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Ensure instance console log exists: /opt/stack/data/nova/instances/0274d8c3-6a83-4959-85a6-4b8168a43df0/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Start _get_guest_xml network_info=[{"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdTxZNec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0274d8c3-6a83-4959-85a6-4b8168a43df0', 'attached_at': '', 'detached_at': '', 'volume_id': '9326cea9-3b72-4121-94cc-f2e6246f1108', 'serial': '9326cea9-3b72-4121-94cc-f2e6246f1108'}, 'attachment_id': '742ecd93-1069-4d00-aec6-e8b203ecd5bf', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-27c2a120-bf41-43cf-adb4-fe6856191007 req-5836f485-1fe4-427b-9c3d-375910f4d0a3 service nova] Acquired lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-27c2a120-bf41-43cf-adb4-fe6856191007 req-5836f485-1fe4-427b-9c3d-375910f4d0a3 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Refreshing network info cache for port 1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:13:14 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:13:14 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.objects.instance [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0274d8c3-6a83-4959-85a6-4b8168a43df0 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.objects.base [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Object Instance<0274d8c3-6a83-4959-85a6-4b8168a43df0> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdTxZNec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:13:14 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:13:14 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:13:14 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d24863a-e14a-4ea7-be81-0c6e8921b714]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:13:14 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed3defc-2e44-4c34-a9aa-7a80121586ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108] added
Oct 30 11:13:14 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee852cb-64cf-439a-a28e-1f1adc6a6f64]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3c286b-9946-42c9-85ca-435d828b6bd1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdTxZNec {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdTxZNec" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7204abb1-458e-4e15-acd1-bf75ddb70751]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bdTxZNec'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec57feac-d01f-47b9-97be-0ca0303727eb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[204ecc05-7269-4bf5-bbe6-e62bb6245f52]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:13:14 user nova-compute[74278]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)
Oct 30 11:13:14 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:13:14 user nova-compute[74278]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)
Oct 30 11:13:14 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[677bc8bb-5479-483f-87eb-eb735e953df0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260]
Oct 30 11:13:14 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260] successful.
Oct 30 11:13:14 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96bf89a-a4ef-4691-b039-0e3d88856859]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5adede-936e-4e12-90b1-42925fa6e00c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:13:14 user nova-compute[74278]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)
Oct 30 11:13:14 user nova-compute[74278]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:13:14 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:13:14 user nova-compute[74278]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)
Oct 30 11:13:14 user nova-compute[74278]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:13:14 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5e8a44-c4f6-46dd-9f49-17b80b778001]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-27c2a120-bf41-43cf-adb4-fe6856191007 req-5836f485-1fe4-427b-9c3d-375910f4d0a3 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updated VIF entry in instance network info cache for port 1491bcc7-6199-4857-a8b0-ad1efc591df5. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-27c2a120-bf41-43cf-adb4-fe6856191007 req-5836f485-1fe4-427b-9c3d-375910f4d0a3 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating instance_info_cache with network_info: [{"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:13:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-27c2a120-bf41-43cf-adb4-fe6856191007 req-5836f485-1fe4-427b-9c3d-375910f4d0a3 service nova] Releasing lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdTxZNec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26263373635346237', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263373635346237', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1141748642',display_name='tempest-TestShelveInstance-server-1141748642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1141748642',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1615884152',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:09:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='af9e783ec7f44a65b46dac4e2c11e5b1',ramdisk_id='',reservation_id='r-e80lsc1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1856925634',owner_user_name='tempest-TestShelveInstance-1856925634-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:12:53Z,user_data=None,user_id='6b92838c59a9488bb72de434b984abf7',uuid=0274d8c3-6a83-4959-85a6-4b8168a43df0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Converting VIF {"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG nova.objects.instance [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lazy-loading 'pci_devices' on Instance uuid 0274d8c3-6a83-4959-85a6-4b8168a43df0 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG nova.objects.base [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Object Instance<0274d8c3-6a83-4959-85a6-4b8168a43df0> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:13:15 user nova-compute[74278]:   <uuid>0274d8c3-6a83-4959-85a6-4b8168a43df0</uuid>
Oct 30 11:13:15 user nova-compute[74278]:   <name>instance-00000024</name>
Oct 30 11:13:15 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:13:15 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:13:15 user nova-compute[74278]:   <metadata>
Oct 30 11:13:15 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:13:15 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:13:15 user nova-compute[74278]:       <nova:name>tempest-TestShelveInstance-server-1141748642</nova:name>
Oct 30 11:13:15 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:13:14</nova:creationTime>
Oct 30 11:13:15 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:13:15 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:13:15 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:13:15 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:13:15 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:13:15 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:13:15 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:13:15 user nova-compute[74278]:       <nova:owner>
Oct 30 11:13:15 user nova-compute[74278]:         <nova:user uuid="6b92838c59a9488bb72de434b984abf7">tempest-TestShelveInstance-1856925634-project-member</nova:user>
Oct 30 11:13:15 user nova-compute[74278]:         <nova:project uuid="af9e783ec7f44a65b46dac4e2c11e5b1">tempest-TestShelveInstance-1856925634</nova:project>
Oct 30 11:13:15 user nova-compute[74278]:       </nova:owner>
Oct 30 11:13:15 user nova-compute[74278]:       <nova:ports>
Oct 30 11:13:15 user nova-compute[74278]:         <nova:port uuid="1491bcc7-6199-4857-a8b0-ad1efc591df5">
Oct 30 11:13:15 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 11:13:15 user nova-compute[74278]:         </nova:port>
Oct 30 11:13:15 user nova-compute[74278]:       </nova:ports>
Oct 30 11:13:15 user nova-compute[74278]:     </nova:instance>
Oct 30 11:13:15 user nova-compute[74278]:   </metadata>
Oct 30 11:13:15 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:13:15 user nova-compute[74278]:     <system>
Oct 30 11:13:15 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:13:15 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:13:15 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:13:15 user nova-compute[74278]:       <entry name="serial">0274d8c3-6a83-4959-85a6-4b8168a43df0</entry>
Oct 30 11:13:15 user nova-compute[74278]:       <entry name="uuid">0274d8c3-6a83-4959-85a6-4b8168a43df0</entry>
Oct 30 11:13:15 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:13:15 user nova-compute[74278]:     </system>
Oct 30 11:13:15 user nova-compute[74278]:   </sysinfo>
Oct 30 11:13:15 user nova-compute[74278]:   <os>
Oct 30 11:13:15 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:13:15 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:13:15 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:13:15 user nova-compute[74278]:   </os>
Oct 30 11:13:15 user nova-compute[74278]:   <features>
Oct 30 11:13:15 user nova-compute[74278]:     <acpi/>
Oct 30 11:13:15 user nova-compute[74278]:     <apic/>
Oct 30 11:13:15 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:13:15 user nova-compute[74278]:   </features>
Oct 30 11:13:15 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:13:15 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:13:15 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:13:15 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:13:15 user nova-compute[74278]:   </clock>
Oct 30 11:13:15 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:13:15 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:13:15 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:13:15 user nova-compute[74278]:   </cpu>
Oct 30 11:13:15 user nova-compute[74278]:   <devices>
Oct 30 11:13:15 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:13:15 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:13:15 user nova-compute[74278]:       <source dev="/dev/sdb"/>
Oct 30 11:13:15 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:13:15 user nova-compute[74278]:       <serial>9326cea9-3b72-4121-94cc-f2e6246f1108</serial>
Oct 30 11:13:15 user nova-compute[74278]:     </disk>
Oct 30 11:13:15 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:13:15 user nova-compute[74278]:       <mac address="fa:16:3e:ca:8e:78"/>
Oct 30 11:13:15 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:13:15 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:13:15 user nova-compute[74278]:       <target dev="tap1491bcc7-61"/>
Oct 30 11:13:15 user nova-compute[74278]:     </interface>
Oct 30 11:13:15 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:13:15 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/0274d8c3-6a83-4959-85a6-4b8168a43df0/console.log" append="off"/>
Oct 30 11:13:15 user nova-compute[74278]:     </serial>
Oct 30 11:13:15 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:13:15 user nova-compute[74278]:     <video>
Oct 30 11:13:15 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:13:15 user nova-compute[74278]:     </video>
Oct 30 11:13:15 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:13:15 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:13:15 user nova-compute[74278]:     </rng>
Oct 30 11:13:15 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:13:15 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:13:15 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:13:15 user nova-compute[74278]:     </memballoon>
Oct 30 11:13:15 user nova-compute[74278]:   </devices>
Oct 30 11:13:15 user nova-compute[74278]: </domain>
Oct 30 11:13:15 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1141748642',display_name='tempest-TestShelveInstance-server-1141748642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1141748642',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1615884152',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:09:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='af9e783ec7f44a65b46dac4e2c11e5b1',ramdisk_id='',reservation_id='r-e80lsc1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1856925634',owner_user_name='tempest-TestShelveInstance-1856925634-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:12:53Z,user_data=None,user_id='6b92838c59a9488bb72de434b984abf7',uuid=0274d8c3-6a83-4959-85a6-4b8168a43df0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Converting VIF {"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG os_vif [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83d1c635-566e-56e9-aebd-cdf69924daad', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1491bcc7-61, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1491bcc7-61, col_values=(('qos', UUID('56f6c2c2-213e-49fc-834b-6bc452720d42')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1491bcc7-61, col_values=(('external_ids', {'iface-id': '1491bcc7-6199-4857-a8b0-ad1efc591df5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:8e:78', 'vm-uuid': '0274d8c3-6a83-4959-85a6-4b8168a43df0'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:15 user nova-compute[74278]: INFO os_vif [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61')
Oct 30 11:13:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:13:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] No VIF found with MAC fa:16:3e:ca:8e:78, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:13:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-d6c24cef-0d7e-4386-9f9d-8204b7a44f5f req-dde869f3-d0cf-4501-9ea9-44bd302513d1 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:13:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d6c24cef-0d7e-4386-9f9d-8204b7a44f5f req-dde869f3-d0cf-4501-9ea9-44bd302513d1 service nova] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d6c24cef-0d7e-4386-9f9d-8204b7a44f5f req-dde869f3-d0cf-4501-9ea9-44bd302513d1 service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d6c24cef-0d7e-4386-9f9d-8204b7a44f5f req-dde869f3-d0cf-4501-9ea9-44bd302513d1 service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-d6c24cef-0d7e-4386-9f9d-8204b7a44f5f req-dde869f3-d0cf-4501-9ea9-44bd302513d1 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] No waiting events found dispatching network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:13:17 user nova-compute[74278]: WARNING nova.compute.manager [req-d6c24cef-0d7e-4386-9f9d-8204b7a44f5f req-dde869f3-d0cf-4501-9ea9-44bd302513d1 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received unexpected event network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 11:13:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:19 user nova-compute[74278]: DEBUG nova.compute.manager [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:13:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:13:19 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Instance spawned successfully.
Oct 30 11:13:19 user nova-compute[74278]: DEBUG nova.compute.manager [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:13:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-892d0173-b234-48ff-ba35-ecd913da54b5 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.802s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-ca608e5b-e1c6-48aa-9d0f-48bcb9f95c09 req-69a6c92a-ad5f-4caf-adb6-fafd07250ad4 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:13:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ca608e5b-e1c6-48aa-9d0f-48bcb9f95c09 req-69a6c92a-ad5f-4caf-adb6-fafd07250ad4 service nova] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ca608e5b-e1c6-48aa-9d0f-48bcb9f95c09 req-69a6c92a-ad5f-4caf-adb6-fafd07250ad4 service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ca608e5b-e1c6-48aa-9d0f-48bcb9f95c09 req-69a6c92a-ad5f-4caf-adb6-fafd07250ad4 service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-ca608e5b-e1c6-48aa-9d0f-48bcb9f95c09 req-69a6c92a-ad5f-4caf-adb6-fafd07250ad4 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] No waiting events found dispatching network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:13:19 user nova-compute[74278]: WARNING nova.compute.manager [req-ca608e5b-e1c6-48aa-9d0f-48bcb9f95c09 req-69a6c92a-ad5f-4caf-adb6-fafd07250ad4 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received unexpected event network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 for instance with vm_state active and task_state None.
Oct 30 11:13:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "cbd67692-96bc-4770-b05e-744b4ecf834b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:25 user nova-compute[74278]: INFO nova.compute.manager [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Terminating instance
Oct 30 11:13:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG nova.compute.manager [req-74f08e91-4c87-47f8-95de-a3fc919b720d req-26906d72-dd43-428e-afe8-7ae73c43e1e2 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Received event network-vif-unplugged-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-74f08e91-4c87-47f8-95de-a3fc919b720d req-26906d72-dd43-428e-afe8-7ae73c43e1e2 service nova] Acquiring lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-74f08e91-4c87-47f8-95de-a3fc919b720d req-26906d72-dd43-428e-afe8-7ae73c43e1e2 service nova] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-74f08e91-4c87-47f8-95de-a3fc919b720d req-26906d72-dd43-428e-afe8-7ae73c43e1e2 service nova] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG nova.compute.manager [req-74f08e91-4c87-47f8-95de-a3fc919b720d req-26906d72-dd43-428e-afe8-7ae73c43e1e2 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] No waiting events found dispatching network-vif-unplugged-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG nova.compute.manager [req-74f08e91-4c87-47f8-95de-a3fc919b720d req-26906d72-dd43-428e-afe8-7ae73c43e1e2 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Received event network-vif-unplugged-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:25 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Instance destroyed successfully.
Oct 30 11:13:25 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lazy-loading 'resources' on Instance uuid cbd67692-96bc-4770-b05e-744b4ecf834b {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:11:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-630769668',display_name='tempest-TestVolumeBootPattern-server-630769668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-630769668',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:12:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-wiu9y1ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:12:11Z,user_data=None,user_id='e921926b3790497fb9630088c501af82',uuid=cbd67692-96bc-4770-b05e-744b4ecf834b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "address": "fa:16:3e:78:54:3d", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ef729a-0b", "ovs_interfaceid": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "address": "fa:16:3e:78:54:3d", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5ef729a-0b", "ovs_interfaceid": "c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ef729a-0b') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG os_vif [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ef729a-0b') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5ef729a-0b, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:13:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfb4034a-878a-4564-bd01-4e0815a51f03) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:26 user nova-compute[74278]: INFO os_vif [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:54:3d,bridge_name='br-int',has_traffic_filtering=True,id=c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5ef729a-0b')
Oct 30 11:13:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QzphVIti', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:13:26 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f086649-b34b-4b6e-81fc-a31cab1800bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:13:26 user nova-compute[74278]: No targets found.
Oct 30 11:13:26 user nova-compute[74278]: iSNS:
Oct 30 11:13:26 user nova-compute[74278]: No targets found.
Oct 30 11:13:26 user nova-compute[74278]: STATIC:
Oct 30 11:13:26 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f
Oct 30 11:13:26 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:13:26 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:13:26 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108
Oct 30 11:13:26 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:13:26 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:13:26 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a
Oct 30 11:13:26 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:13:26 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:13:26 user nova-compute[74278]: FIRMWARE:
Oct 30 11:13:26 user nova-compute[74278]: No targets found.
Oct 30 11:13:26 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:13:26 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:13:26 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8faddfb-35e0-4443-8a60-e048be9b632e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ac6955-a526-4db1-b459-c4cd6ab66917]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:13:26 user nova-compute[74278]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)
Oct 30 11:13:26 user nova-compute[74278]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:13:26 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:13:26 user nova-compute[74278]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a (non-flash)
Oct 30 11:13:26 user nova-compute[74278]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:13:26 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c32bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a'): ({'sdd'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Removing single pathed devices sdd {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02fabee-e079-4fd4-80dc-3f41bbe9d0ac]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcd4af1-1ad2-4101-b7a2-9b2fb454e2c9]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flushing IO for device /dev/sdd {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9a86a7-7cc9-4f1f-8a02-249bd8c8c6aa]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[922eaa06-26dc-4a10-8723-c8581ea8bd4c]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd926c8b-b680-4c51-9fa6-4857bd9aef35]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[72823145-8ba5-4c31-a8fc-35b7b5d79d3b]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a, portal: 172.16.0.220,3260]
Oct 30 11:13:26 user nova-compute[74278]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a, portal: 172.16.0.220,3260] successful.
Oct 30 11:13:26 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9acb529-a3c8-4fc9-9793-4c15ab3773e9]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== disconnect_volume: return (306ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:13:26 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Deleting instance files /opt/stack/data/nova/instances/cbd67692-96bc-4770-b05e-744b4ecf834b_del
Oct 30 11:13:26 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Deletion of /opt/stack/data/nova/instances/cbd67692-96bc-4770-b05e-744b4ecf834b_del complete
Oct 30 11:13:26 user nova-compute[74278]: INFO nova.compute.manager [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 30 11:13:26 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:13:26 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Took 0.51 seconds to deallocate network for instance.
Oct 30 11:13:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-c92c9316-03ea-415d-9964-e285c7c1bd3c req-2fb672db-e886-4a72-ade0-d7c4559586d7 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Received event network-vif-deleted-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:13:26 user nova-compute[74278]: INFO nova.compute.manager [req-c92c9316-03ea-415d-9964-e285c7c1bd3c req-2fb672db-e886-4a72-ade0-d7c4559586d7 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Neutron deleted interface c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a; detaching it from the instance and deleting it from the info cache
Oct 30 11:13:26 user nova-compute[74278]: DEBUG nova.network.neutron [req-c92c9316-03ea-415d-9964-e285c7c1bd3c req-2fb672db-e886-4a72-ade0-d7c4559586d7 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:13:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-c92c9316-03ea-415d-9964-e285c7c1bd3c req-2fb672db-e886-4a72-ade0-d7c4559586d7 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Detach interface failed, port_id=c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a, reason: Instance cbd67692-96bc-4770-b05e-744b4ecf834b could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:13:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-ae18a80c-62c5-43bd-9ab1-dd04050d8556 req-ba4961b7-a291-4996-9fe8-45d9f9171c87 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Received event network-vif-plugged-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:13:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ae18a80c-62c5-43bd-9ab1-dd04050d8556 req-ba4961b7-a291-4996-9fe8-45d9f9171c87 service nova] Acquiring lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ae18a80c-62c5-43bd-9ab1-dd04050d8556 req-ba4961b7-a291-4996-9fe8-45d9f9171c87 service nova] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ae18a80c-62c5-43bd-9ab1-dd04050d8556 req-ba4961b7-a291-4996-9fe8-45d9f9171c87 service nova] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-ae18a80c-62c5-43bd-9ab1-dd04050d8556 req-ba4961b7-a291-4996-9fe8-45d9f9171c87 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] No waiting events found dispatching network-vif-plugged-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:13:27 user nova-compute[74278]: WARNING nova.compute.manager [req-ae18a80c-62c5-43bd-9ab1-dd04050d8556 req-ba4961b7-a291-4996-9fe8-45d9f9171c87 service nova] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Received unexpected event network-vif-plugged-c5ef729a-0b4c-4ddb-a4bd-5d9f6d1e980a for instance with vm_state active and task_state deleting.
Oct 30 11:13:27 user nova-compute[74278]: INFO nova.compute.manager [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Took 0.87 seconds to detach 1 volumes for instance.
Oct 30 11:13:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: cbd67692-96bc-4770-b05e-744b4ecf834b] Deleting volume: ae3a3b78-f9cc-4759-81f1-0f7f6c66eb4a {{(pid=74278) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 11:13:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:28 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:13:28 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:13:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:28 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Deleted allocations for instance cbd67692-96bc-4770-b05e-744b4ecf834b
Oct 30 11:13:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8330dad2-6175-4975-844e-a860ae80f29c tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "cbd67692-96bc-4770-b05e-744b4ecf834b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.102s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:33 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:13:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:35 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:13:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:13:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:13:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Didn't find any instances for network info cache update. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 11:13:38 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:13:39 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:13:39 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:13:39 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:13:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:13:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:13:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:40 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:13:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:40 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:13:41 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:13:41 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:13:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8365MB free_disk=24.979480743408203GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a2cde4ee-e665-457a-b5f0-652a2c2b7f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 290c5792-7212-4a44-bf02-b51133a118ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0274d8c3-6a83-4959-85a6-4b8168a43df0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:13:41 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:13:42 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:13:42 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:13:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:13:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:13:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:13:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:13:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "290c5792-7212-4a44-bf02-b51133a118ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:00 user nova-compute[74278]: INFO nova.compute.manager [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Terminating instance
Oct 30 11:14:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-b6db61c6-a82e-48cc-8910-e8c90512e963 req-3e73e97c-7eba-4e59-9710-160b22469397 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-vif-unplugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b6db61c6-a82e-48cc-8910-e8c90512e963 req-3e73e97c-7eba-4e59-9710-160b22469397 service nova] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b6db61c6-a82e-48cc-8910-e8c90512e963 req-3e73e97c-7eba-4e59-9710-160b22469397 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b6db61c6-a82e-48cc-8910-e8c90512e963 req-3e73e97c-7eba-4e59-9710-160b22469397 service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-b6db61c6-a82e-48cc-8910-e8c90512e963 req-3e73e97c-7eba-4e59-9710-160b22469397 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] No waiting events found dispatching network-vif-unplugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:14:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-b6db61c6-a82e-48cc-8910-e8c90512e963 req-3e73e97c-7eba-4e59-9710-160b22469397 service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-vif-unplugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Instance destroyed successfully.
Oct 30 11:14:01 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lazy-loading 'resources' on Instance uuid 290c5792-7212-4a44-bf02-b51133a118ed {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1860907579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1860907579',id=35,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFztOITLCEzqku21cyYAqalG2M4MjHC5UyyK86MtvbzG9S3kb5fO7HAXi5Tf60HBBPdXMmXKdFP3tSLiQbRQcZqjkBRAaao6856gtutBal3xNcRO8Ff2vYGxE8xRxbenA==',key_name='tempest-keypair-1069109495',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:12:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31dd01e2d9be4a0b96e94493f8eb43d7',ramdisk_id='',reservation_id='r-zqi01yl9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2142703659',owner_user_name='tempest-AttachVolumeShelveTestJSON-2142703659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='584de218cec24240a91845deca515efa',uuid=290c5792-7212-4a44-bf02-b51133a118ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converting VIF {"id": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "address": "fa:16:3e:ca:66:3b", "network": {"id": "29c45be1-642e-496d-ab69-0e3b7cd7d260", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1547727220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31dd01e2d9be4a0b96e94493f8eb43d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8eba06a8-c7", "ovs_interfaceid": "8eba06a8-c7a5-478f-8924-bc26b35789c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG os_vif [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8eba06a8-c7, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03e1b843-53e5-4ccb-b985-65d89e28b7b8) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:01 user nova-compute[74278]: INFO os_vif [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:66:3b,bridge_name='br-int',has_traffic_filtering=True,id=8eba06a8-c7a5-478f-8924-bc26b35789c7,network=Network(29c45be1-642e-496d-ab69-0e3b7cd7d260),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8eba06a8-c7')
Oct 30 11:14:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Deleting instance files /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed_del
Oct 30 11:14:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Deletion of /opt/stack/data/nova/instances/290c5792-7212-4a44-bf02-b51133a118ed_del complete
Oct 30 11:14:01 user nova-compute[74278]: INFO nova.compute.manager [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 30 11:14:01 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:14:01 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:14:02 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:14:02 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Took 1.03 seconds to deallocate network for instance.
Oct 30 11:14:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:02 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:14:02 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:14:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:02 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Deleted allocations for instance 290c5792-7212-4a44-bf02-b51133a118ed
Oct 30 11:14:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc610245-f146-4771-b454-5c37effb9b38 req-210c9f4c-4f7f-4237-8a6d-eaea91171f3a service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:14:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc610245-f146-4771-b454-5c37effb9b38 req-210c9f4c-4f7f-4237-8a6d-eaea91171f3a service nova] Acquiring lock "290c5792-7212-4a44-bf02-b51133a118ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc610245-f146-4771-b454-5c37effb9b38 req-210c9f4c-4f7f-4237-8a6d-eaea91171f3a service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc610245-f146-4771-b454-5c37effb9b38 req-210c9f4c-4f7f-4237-8a6d-eaea91171f3a service nova] Lock "290c5792-7212-4a44-bf02-b51133a118ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc610245-f146-4771-b454-5c37effb9b38 req-210c9f4c-4f7f-4237-8a6d-eaea91171f3a service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] No waiting events found dispatching network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:14:02 user nova-compute[74278]: WARNING nova.compute.manager [req-bc610245-f146-4771-b454-5c37effb9b38 req-210c9f4c-4f7f-4237-8a6d-eaea91171f3a service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received unexpected event network-vif-plugged-8eba06a8-c7a5-478f-8924-bc26b35789c7 for instance with vm_state deleted and task_state None.
Oct 30 11:14:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc610245-f146-4771-b454-5c37effb9b38 req-210c9f4c-4f7f-4237-8a6d-eaea91171f3a service nova] [instance: 290c5792-7212-4a44-bf02-b51133a118ed] Received event network-vif-deleted-8eba06a8-c7a5-478f-8924-bc26b35789c7 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:14:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8286643d-fae4-4db5-873f-97a114b033d0 tempest-AttachVolumeShelveTestJSON-2142703659 tempest-AttachVolumeShelveTestJSON-2142703659-project-member] Lock "290c5792-7212-4a44-bf02-b51133a118ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.376s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:14:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:14:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:14:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:14:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:14:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "00633014-ff03-4230-97fb-a81ce613c92d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "00633014-ff03-4230-97fb-a81ce613c92d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:14:23 user nova-compute[74278]: INFO nova.compute.claims [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Claim successful on node user
Oct 30 11:14:23 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG nova.network.neutron [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:14:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:14:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG nova.policy [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffaf2383261d4cc1a6d7b304f515914b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ee9b3a0343474183d1e12dcef41703', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:14:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Creating image(s)
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "/opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "/opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "/opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.222s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk 1073741824" returned: 0 in 0.047s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.171s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Cannot resize image /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Ensure instance console log exists: /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:24 user nova-compute[74278]: DEBUG nova.network.neutron [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Successfully created port: 89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Successfully updated port: 89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "refresh_cache-00633014-ff03-4230-97fb-a81ce613c92d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquired lock "refresh_cache-00633014-ff03-4230-97fb-a81ce613c92d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.compute.manager [req-24c29d46-74b7-44be-ad76-3b85069a2b5e req-22aefa59-39c8-4c96-8e05-85664f357f26 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Received event network-changed-89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.compute.manager [req-24c29d46-74b7-44be-ad76-3b85069a2b5e req-22aefa59-39c8-4c96-8e05-85664f357f26 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Refreshing instance network info cache due to event network-changed-89b53b4f-7677-4b8f-9253-14b9d6091ea2. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-24c29d46-74b7-44be-ad76-3b85069a2b5e req-22aefa59-39c8-4c96-8e05-85664f357f26 service nova] Acquiring lock "refresh_cache-00633014-ff03-4230-97fb-a81ce613c92d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.network.neutron [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Updating instance_info_cache with network_info: [{"id": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "address": "fa:16:3e:be:97:6d", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b53b4f-76", "ovs_interfaceid": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Releasing lock "refresh_cache-00633014-ff03-4230-97fb-a81ce613c92d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.compute.manager [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Instance network_info: |[{"id": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "address": "fa:16:3e:be:97:6d", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b53b4f-76", "ovs_interfaceid": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-24c29d46-74b7-44be-ad76-3b85069a2b5e req-22aefa59-39c8-4c96-8e05-85664f357f26 service nova] Acquired lock "refresh_cache-00633014-ff03-4230-97fb-a81ce613c92d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.network.neutron [req-24c29d46-74b7-44be-ad76-3b85069a2b5e req-22aefa59-39c8-4c96-8e05-85664f357f26 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Refreshing network info cache for port 89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Start _get_guest_xml network_info=[{"id": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "address": "fa:16:3e:be:97:6d", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b53b4f-76", "ovs_interfaceid": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:14:25 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:14:25 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1390899367',display_name='tempest-VolumesSnapshotTestJSON-instance-1390899367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1390899367',id=41,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzsvg61NNh95ESK/Gd9nrPK7HksBc4os15Fo24nxZmjO7DT0Hv9ydJsB8xEvK/BU8qlUOuE3X04hSonDHj79gcu2mAL9oIj1u9yV8AbB+17rkvTkNlTZ6cCPUEsJGslBg==',key_name='tempest-keypair-1399232390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59ee9b3a0343474183d1e12dcef41703',ramdisk_id='',reservation_id='r-yggsd34x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-24712219',owner_user_name='tempest-VolumesSnapshotTestJSON-24712219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:14:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffaf2383261d4cc1a6d7b304f515914b',uuid=00633014-ff03-4230-97fb-a81ce613c92d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "address": "fa:16:3e:be:97:6d", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b53b4f-76", "ovs_interfaceid": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Converting VIF {"id": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "address": "fa:16:3e:be:97:6d", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b53b4f-76", "ovs_interfaceid": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:97:6d,bridge_name='br-int',has_traffic_filtering=True,id=89b53b4f-7677-4b8f-9253-14b9d6091ea2,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b53b4f-76') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.objects.instance [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lazy-loading 'pci_devices' on Instance uuid 00633014-ff03-4230-97fb-a81ce613c92d {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:14:25 user nova-compute[74278]:   <uuid>00633014-ff03-4230-97fb-a81ce613c92d</uuid>
Oct 30 11:14:25 user nova-compute[74278]:   <name>instance-00000029</name>
Oct 30 11:14:25 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:14:25 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:14:25 user nova-compute[74278]:   <metadata>
Oct 30 11:14:25 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:14:25 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:14:25 user nova-compute[74278]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1390899367</nova:name>
Oct 30 11:14:25 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:14:25</nova:creationTime>
Oct 30 11:14:25 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:14:25 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:14:25 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:14:25 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:14:25 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:14:25 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:14:25 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:14:25 user nova-compute[74278]:       <nova:owner>
Oct 30 11:14:25 user nova-compute[74278]:         <nova:user uuid="ffaf2383261d4cc1a6d7b304f515914b">tempest-VolumesSnapshotTestJSON-24712219-project-member</nova:user>
Oct 30 11:14:25 user nova-compute[74278]:         <nova:project uuid="59ee9b3a0343474183d1e12dcef41703">tempest-VolumesSnapshotTestJSON-24712219</nova:project>
Oct 30 11:14:25 user nova-compute[74278]:       </nova:owner>
Oct 30 11:14:25 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:14:25 user nova-compute[74278]:       <nova:ports>
Oct 30 11:14:25 user nova-compute[74278]:         <nova:port uuid="89b53b4f-7677-4b8f-9253-14b9d6091ea2">
Oct 30 11:14:25 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 11:14:25 user nova-compute[74278]:         </nova:port>
Oct 30 11:14:25 user nova-compute[74278]:       </nova:ports>
Oct 30 11:14:25 user nova-compute[74278]:     </nova:instance>
Oct 30 11:14:25 user nova-compute[74278]:   </metadata>
Oct 30 11:14:25 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:14:25 user nova-compute[74278]:     <system>
Oct 30 11:14:25 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:14:25 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:14:25 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:14:25 user nova-compute[74278]:       <entry name="serial">00633014-ff03-4230-97fb-a81ce613c92d</entry>
Oct 30 11:14:25 user nova-compute[74278]:       <entry name="uuid">00633014-ff03-4230-97fb-a81ce613c92d</entry>
Oct 30 11:14:25 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:14:25 user nova-compute[74278]:     </system>
Oct 30 11:14:25 user nova-compute[74278]:   </sysinfo>
Oct 30 11:14:25 user nova-compute[74278]:   <os>
Oct 30 11:14:25 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:14:25 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:14:25 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:14:25 user nova-compute[74278]:   </os>
Oct 30 11:14:25 user nova-compute[74278]:   <features>
Oct 30 11:14:25 user nova-compute[74278]:     <acpi/>
Oct 30 11:14:25 user nova-compute[74278]:     <apic/>
Oct 30 11:14:25 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:14:25 user nova-compute[74278]:   </features>
Oct 30 11:14:25 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:14:25 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:14:25 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:14:25 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:14:25 user nova-compute[74278]:   </clock>
Oct 30 11:14:25 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:14:25 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:14:25 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:14:25 user nova-compute[74278]:   </cpu>
Oct 30 11:14:25 user nova-compute[74278]:   <devices>
Oct 30 11:14:25 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:14:25 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:14:25 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk"/>
Oct 30 11:14:25 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:14:25 user nova-compute[74278]:     </disk>
Oct 30 11:14:25 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:14:25 user nova-compute[74278]:       <mac address="fa:16:3e:be:97:6d"/>
Oct 30 11:14:25 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:14:25 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:14:25 user nova-compute[74278]:       <target dev="tap89b53b4f-76"/>
Oct 30 11:14:25 user nova-compute[74278]:     </interface>
Oct 30 11:14:25 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:14:25 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/console.log" append="off"/>
Oct 30 11:14:25 user nova-compute[74278]:     </serial>
Oct 30 11:14:25 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:14:25 user nova-compute[74278]:     <video>
Oct 30 11:14:25 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:14:25 user nova-compute[74278]:     </video>
Oct 30 11:14:25 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:14:25 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:14:25 user nova-compute[74278]:     </rng>
Oct 30 11:14:25 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:14:25 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:14:25 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:14:25 user nova-compute[74278]:     </memballoon>
Oct 30 11:14:25 user nova-compute[74278]:   </devices>
Oct 30 11:14:25 user nova-compute[74278]: </domain>
Oct 30 11:14:25 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1390899367',display_name='tempest-VolumesSnapshotTestJSON-instance-1390899367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1390899367',id=41,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzsvg61NNh95ESK/Gd9nrPK7HksBc4os15Fo24nxZmjO7DT0Hv9ydJsB8xEvK/BU8qlUOuE3X04hSonDHj79gcu2mAL9oIj1u9yV8AbB+17rkvTkNlTZ6cCPUEsJGslBg==',key_name='tempest-keypair-1399232390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59ee9b3a0343474183d1e12dcef41703',ramdisk_id='',reservation_id='r-yggsd34x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-24712219',owner_user_name='tempest-VolumesSnapshotTestJSON-24712219-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:14:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffaf2383261d4cc1a6d7b304f515914b',uuid=00633014-ff03-4230-97fb-a81ce613c92d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "address": "fa:16:3e:be:97:6d", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b53b4f-76", "ovs_interfaceid": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Converting VIF {"id": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "address": "fa:16:3e:be:97:6d", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b53b4f-76", "ovs_interfaceid": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:97:6d,bridge_name='br-int',has_traffic_filtering=True,id=89b53b4f-7677-4b8f-9253-14b9d6091ea2,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b53b4f-76') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG os_vif [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:97:6d,bridge_name='br-int',has_traffic_filtering=True,id=89b53b4f-7677-4b8f-9253-14b9d6091ea2,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b53b4f-76') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a53f2931-fb6f-5b26-aa7a-124b26897ec9', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89b53b4f-76, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89b53b4f-76, col_values=(('qos', UUID('36d40f77-034a-4130-938f-4f0907218eff')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89b53b4f-76, col_values=(('external_ids', {'iface-id': '89b53b4f-7677-4b8f-9253-14b9d6091ea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:97:6d', 'vm-uuid': '00633014-ff03-4230-97fb-a81ce613c92d'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:14:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:25 user nova-compute[74278]: INFO os_vif [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:97:6d,bridge_name='br-int',has_traffic_filtering=True,id=89b53b4f-7677-4b8f-9253-14b9d6091ea2,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b53b4f-76')
Oct 30 11:14:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:14:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] No VIF found with MAC fa:16:3e:be:97:6d, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:14:26 user nova-compute[74278]: DEBUG nova.network.neutron [req-24c29d46-74b7-44be-ad76-3b85069a2b5e req-22aefa59-39c8-4c96-8e05-85664f357f26 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Updated VIF entry in instance network info cache for port 89b53b4f-7677-4b8f-9253-14b9d6091ea2. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:14:26 user nova-compute[74278]: DEBUG nova.network.neutron [req-24c29d46-74b7-44be-ad76-3b85069a2b5e req-22aefa59-39c8-4c96-8e05-85664f357f26 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Updating instance_info_cache with network_info: [{"id": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "address": "fa:16:3e:be:97:6d", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b53b4f-76", "ovs_interfaceid": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:14:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-24c29d46-74b7-44be-ad76-3b85069a2b5e req-22aefa59-39c8-4c96-8e05-85664f357f26 service nova] Releasing lock "refresh_cache-00633014-ff03-4230-97fb-a81ce613c92d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:14:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-c96773e7-cf86-433a-934e-c9795cd904f1 req-824e2f03-328e-45a7-9015-ff0101e89de9 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Received event network-vif-plugged-89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:14:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c96773e7-cf86-433a-934e-c9795cd904f1 req-824e2f03-328e-45a7-9015-ff0101e89de9 service nova] Acquiring lock "00633014-ff03-4230-97fb-a81ce613c92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c96773e7-cf86-433a-934e-c9795cd904f1 req-824e2f03-328e-45a7-9015-ff0101e89de9 service nova] Lock "00633014-ff03-4230-97fb-a81ce613c92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c96773e7-cf86-433a-934e-c9795cd904f1 req-824e2f03-328e-45a7-9015-ff0101e89de9 service nova] Lock "00633014-ff03-4230-97fb-a81ce613c92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:27 user nova-compute[74278]: DEBUG nova.compute.manager [req-c96773e7-cf86-433a-934e-c9795cd904f1 req-824e2f03-328e-45a7-9015-ff0101e89de9 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] No waiting events found dispatching network-vif-plugged-89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:14:27 user nova-compute[74278]: WARNING nova.compute.manager [req-c96773e7-cf86-433a-934e-c9795cd904f1 req-824e2f03-328e-45a7-9015-ff0101e89de9 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Received unexpected event network-vif-plugged-89b53b4f-7677-4b8f-9253-14b9d6091ea2 for instance with vm_state building and task_state spawning.
Oct 30 11:14:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG nova.compute.manager [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:14:29 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Instance spawned successfully.
Oct 30 11:14:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG nova.compute.manager [req-496aa7d0-dc22-4435-a18e-05980ba32e72 req-51e1826b-b398-40f3-b1ef-8d708e54bada service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Received event network-vif-plugged-89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-496aa7d0-dc22-4435-a18e-05980ba32e72 req-51e1826b-b398-40f3-b1ef-8d708e54bada service nova] Acquiring lock "00633014-ff03-4230-97fb-a81ce613c92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-496aa7d0-dc22-4435-a18e-05980ba32e72 req-51e1826b-b398-40f3-b1ef-8d708e54bada service nova] Lock "00633014-ff03-4230-97fb-a81ce613c92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-496aa7d0-dc22-4435-a18e-05980ba32e72 req-51e1826b-b398-40f3-b1ef-8d708e54bada service nova] Lock "00633014-ff03-4230-97fb-a81ce613c92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:29 user nova-compute[74278]: DEBUG nova.compute.manager [req-496aa7d0-dc22-4435-a18e-05980ba32e72 req-51e1826b-b398-40f3-b1ef-8d708e54bada service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] No waiting events found dispatching network-vif-plugged-89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:14:29 user nova-compute[74278]: WARNING nova.compute.manager [req-496aa7d0-dc22-4435-a18e-05980ba32e72 req-51e1826b-b398-40f3-b1ef-8d708e54bada service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Received unexpected event network-vif-plugged-89b53b4f-7677-4b8f-9253-14b9d6091ea2 for instance with vm_state building and task_state spawning.
Oct 30 11:14:29 user nova-compute[74278]: INFO nova.compute.manager [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Took 5.78 seconds to spawn the instance on the hypervisor.
Oct 30 11:14:29 user nova-compute[74278]: DEBUG nova.compute.manager [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:14:29 user nova-compute[74278]: INFO nova.compute.manager [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Took 6.40 seconds to build instance.
Oct 30 11:14:29 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-25e2d98a-f238-4919-aa18-6494ffabbe86 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "00633014-ff03-4230-97fb-a81ce613c92d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.527s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:35 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:14:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:14:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:14:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 11:14:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:14:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:14:37 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:14:37 user nova-compute[74278]: DEBUG nova.objects.instance [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lazy-loading 'info_cache' on Instance uuid 65466a3f-2824-4172-a3c2-8fba650788e9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:14:37 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updating instance_info_cache with network_info: [{"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:14:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-65466a3f-2824-4172-a3c2-8fba650788e9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:14:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:14:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:14:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:14:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:14:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:14:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:14:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:14:42 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:14:42 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:14:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:42 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:14:42 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:14:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:42 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-e0889d37-373c-4739-ad2a-ec50d2f63c4f req-017c4725-8376-48aa-a794-3935aba1113a service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-changed-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-e0889d37-373c-4739-ad2a-ec50d2f63c4f req-017c4725-8376-48aa-a794-3935aba1113a service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Refreshing instance network info cache due to event network-changed-1491bcc7-6199-4857-a8b0-ad1efc591df5. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e0889d37-373c-4739-ad2a-ec50d2f63c4f req-017c4725-8376-48aa-a794-3935aba1113a service nova] Acquiring lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e0889d37-373c-4739-ad2a-ec50d2f63c4f req-017c4725-8376-48aa-a794-3935aba1113a service nova] Acquired lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG nova.network.neutron [req-e0889d37-373c-4739-ad2a-ec50d2f63c4f req-017c4725-8376-48aa-a794-3935aba1113a service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Refreshing network info cache for port 1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:14:43 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:14:43 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:14:43 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8299MB free_disk=24.97771453857422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:43 user nova-compute[74278]: INFO nova.compute.manager [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Terminating instance
Oct 30 11:14:43 user nova-compute[74278]: DEBUG nova.compute.manager [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a2cde4ee-e665-457a-b5f0-652a2c2b7f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0274d8c3-6a83-4959-85a6-4b8168a43df0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00633014-ff03-4230-97fb-a81ce613c92d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:14:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-47ff162c-c92f-4d55-882e-5faf3592fce8 req-9982d6b8-78e0-4a5e-bc7b-f47d3ac9548b service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-vif-unplugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-47ff162c-c92f-4d55-882e-5faf3592fce8 req-9982d6b8-78e0-4a5e-bc7b-f47d3ac9548b service nova] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-47ff162c-c92f-4d55-882e-5faf3592fce8 req-9982d6b8-78e0-4a5e-bc7b-f47d3ac9548b service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-47ff162c-c92f-4d55-882e-5faf3592fce8 req-9982d6b8-78e0-4a5e-bc7b-f47d3ac9548b service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-47ff162c-c92f-4d55-882e-5faf3592fce8 req-9982d6b8-78e0-4a5e-bc7b-f47d3ac9548b service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] No waiting events found dispatching network-vif-unplugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-47ff162c-c92f-4d55-882e-5faf3592fce8 req-9982d6b8-78e0-4a5e-bc7b-f47d3ac9548b service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-vif-unplugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-e0889d37-373c-4739-ad2a-ec50d2f63c4f req-017c4725-8376-48aa-a794-3935aba1113a service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updated VIF entry in instance network info cache for port 1491bcc7-6199-4857-a8b0-ad1efc591df5. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-e0889d37-373c-4739-ad2a-ec50d2f63c4f req-017c4725-8376-48aa-a794-3935aba1113a service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating instance_info_cache with network_info: [{"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e0889d37-373c-4739-ad2a-ec50d2f63c4f req-017c4725-8376-48aa-a794-3935aba1113a service nova] Releasing lock "refresh_cache-0274d8c3-6a83-4959-85a6-4b8168a43df0" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:14:44 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Instance destroyed successfully.
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.objects.instance [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lazy-loading 'resources' on Instance uuid 0274d8c3-6a83-4959-85a6-4b8168a43df0 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T11:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1141748642',display_name='tempest-TestShelveInstance-server-1141748642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1141748642',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjajcqPMAHLG5BDRh8OD9ZGA5CKTelBhRuT/G7iIHJd8dsF5nAIa7BHI3I4Fbbc5SqqA/eYbWHvIRDp5Is/LZBwmEgeiE8F2co+QnBDTqzi8c7WBLfkmSY+V8sZ+/nj0g==',key_name='tempest-TestShelveInstance-1615884152',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='af9e783ec7f44a65b46dac4e2c11e5b1',ramdisk_id='',reservation_id='r-e80lsc1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1856925634',owner_user_name='tempest-TestShelveInstance-1856925634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:13:19Z,user_data=None,user_id='6b92838c59a9488bb72de434b984abf7',uuid=0274d8c3-6a83-4959-85a6-4b8168a43df0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Converting VIF {"id": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "address": "fa:16:3e:ca:8e:78", "network": {"id": "f038fec6-5c8e-4e10-8485-92a9e43230f7", "bridge": "br-int", "label": "tempest-TestShelveInstance-2128448767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "af9e783ec7f44a65b46dac4e2c11e5b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1491bcc7-61", "ovs_interfaceid": "1491bcc7-6199-4857-a8b0-ad1efc591df5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_vif [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1491bcc7-61, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56f6c2c2-213e-49fc-834b-6bc452720d42) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:14:44 user nova-compute[74278]: INFO os_vif [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:8e:78,bridge_name='br-int',has_traffic_filtering=True,id=1491bcc7-6199-4857-a8b0-ad1efc591df5,network=Network(f038fec6-5c8e-4e10-8485-92a9e43230f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1491bcc7-61')
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdTxZNec', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:14:44 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda05af4-66f4-4331-b93c-50c7dca8ef7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:14:44 user nova-compute[74278]: No targets found.
Oct 30 11:14:44 user nova-compute[74278]: iSNS:
Oct 30 11:14:44 user nova-compute[74278]: No targets found.
Oct 30 11:14:44 user nova-compute[74278]: STATIC:
Oct 30 11:14:44 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f
Oct 30 11:14:44 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:14:44 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:14:44 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108
Oct 30 11:14:44 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:14:44 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:14:44 user nova-compute[74278]: FIRMWARE:
Oct 30 11:14:44 user nova-compute[74278]: No targets found.
Oct 30 11:14:44 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:14:44 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:14:44 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cc7cff-407d-46df-bbe3-786ffa497618]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[91798049-1051-444b-a572-e5ab8e015868]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:14:44 user nova-compute[74278]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:14:44 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:14:44 user nova-compute[74278]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 (non-flash)
Oct 30 11:14:44 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c3291b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93908d4-3605-41fe-9980-d096749a85fd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeae6c5-d38a-422c-91f2-673afe5803a0]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[585b9e33-177b-49c3-af3b-c58378d2753c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10d36a4-e980-4f8e-97ad-5f9627aa5df6]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_aa73c916', '/dev/disk/by-id/scsi-1SCST_BIOaa73c916-bc7654b7f7205d87', '/dev/disk/by-id/scsi-26263373635346237') {{(pid=85487) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7441d12a-9cd6-4b4b-9b40-5d5ebc738c1b]: (4, None) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[380f155c-7e91-40a3-a8b9-358d860201a0]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e1ffaf-0036-4db0-b8d3-8e5d0eecd0a4]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260]
Oct 30 11:14:44 user nova-compute[74278]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108, portal: 172.16.0.220,3260] successful.
Oct 30 11:14:44 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9326cea9-3b72-4121-94cc-f2e6246f1108 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a98b07f-12ef-45cc-a0d6-0918f3dfbc8e]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] <== disconnect_volume: return (349ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:14:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:14:44 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Deleting instance files /opt/stack/data/nova/instances/0274d8c3-6a83-4959-85a6-4b8168a43df0_del
Oct 30 11:14:44 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Deletion of /opt/stack/data/nova/instances/0274d8c3-6a83-4959-85a6-4b8168a43df0_del complete
Oct 30 11:14:45 user nova-compute[74278]: INFO nova.compute.manager [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 30 11:14:45 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:14:45 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:14:45 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:14:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:45 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:14:45 user nova-compute[74278]: DEBUG nova.compute.manager [req-47ea8b81-0b51-45ce-a272-fca261301268 req-9f191fe6-1c66-4625-87a8-a3c3072f9551 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-vif-deleted-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:14:45 user nova-compute[74278]: INFO nova.compute.manager [req-47ea8b81-0b51-45ce-a272-fca261301268 req-9f191fe6-1c66-4625-87a8-a3c3072f9551 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Neutron deleted interface 1491bcc7-6199-4857-a8b0-ad1efc591df5; detaching it from the instance and deleting it from the info cache
Oct 30 11:14:45 user nova-compute[74278]: DEBUG nova.network.neutron [req-47ea8b81-0b51-45ce-a272-fca261301268 req-9f191fe6-1c66-4625-87a8-a3c3072f9551 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:14:45 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Took 0.53 seconds to deallocate network for instance.
Oct 30 11:14:45 user nova-compute[74278]: DEBUG nova.compute.manager [req-47ea8b81-0b51-45ce-a272-fca261301268 req-9f191fe6-1c66-4625-87a8-a3c3072f9551 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Detach interface failed, port_id=1491bcc7-6199-4857-a8b0-ad1efc591df5, reason: Instance 0274d8c3-6a83-4959-85a6-4b8168a43df0 could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:14:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-d9b11e8e-52b1-41fd-8ad8-46dce0bbea40 req-faf8d5c9-c77d-400b-b8db-daec9d348c19 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received event network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:14:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d9b11e8e-52b1-41fd-8ad8-46dce0bbea40 req-faf8d5c9-c77d-400b-b8db-daec9d348c19 service nova] Acquiring lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d9b11e8e-52b1-41fd-8ad8-46dce0bbea40 req-faf8d5c9-c77d-400b-b8db-daec9d348c19 service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d9b11e8e-52b1-41fd-8ad8-46dce0bbea40 req-faf8d5c9-c77d-400b-b8db-daec9d348c19 service nova] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-d9b11e8e-52b1-41fd-8ad8-46dce0bbea40 req-faf8d5c9-c77d-400b-b8db-daec9d348c19 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] No waiting events found dispatching network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:14:46 user nova-compute[74278]: WARNING nova.compute.manager [req-d9b11e8e-52b1-41fd-8ad8-46dce0bbea40 req-faf8d5c9-c77d-400b-b8db-daec9d348c19 service nova] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Received unexpected event network-vif-plugged-1491bcc7-6199-4857-a8b0-ad1efc591df5 for instance with vm_state active and task_state deleting.
Oct 30 11:14:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:14:46 user nova-compute[74278]: INFO nova.compute.manager [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Took 0.87 seconds to detach 1 volumes for instance.
Oct 30 11:14:46 user nova-compute[74278]: DEBUG nova.compute.manager [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] [instance: 0274d8c3-6a83-4959-85a6-4b8168a43df0] Deleting volume: 9326cea9-3b72-4121-94cc-f2e6246f1108 {{(pid=74278) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 11:14:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:46 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:14:46 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:14:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:46 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Deleted allocations for instance 0274d8c3-6a83-4959-85a6-4b8168a43df0
Oct 30 11:14:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-172c3aea-9a9c-47a4-b6ec-36e1e3e2a514 tempest-TestShelveInstance-1856925634 tempest-TestShelveInstance-1856925634-project-member] Lock "0274d8c3-6a83-4959-85a6-4b8168a43df0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.106s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:49 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:14:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:14:57 user nova-compute[74278]: INFO nova.compute.manager [None req-952eee6f-b81a-4e8e-b6f2-4b82f2f9b84b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Get console output
Oct 30 11:14:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:14:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:14:57 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:14:57 user nova-compute[74278]: INFO nova.compute.claims [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Claim successful on node user
Oct 30 11:14:57 user nova-compute[74278]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 30 11:14:57 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:14:57 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:14:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:14:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:14:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:14:57 user nova-compute[74278]: DEBUG nova.network.neutron [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:14:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:14:58 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:14:58 user nova-compute[74278]: INFO nova.virt.block_device [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Booting with volume 225a0e3b-f236-4849-b1e1-8e9e3b1efe8f at /dev/vda
Oct 30 11:14:58 user nova-compute[74278]: DEBUG nova.policy [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e921926b3790497fb9630088c501af82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59235488214e4149a91d6c2d5a02dd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG os_brick.utils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1614d7d-d712-417a-9b4d-0570f76f6f2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[af09760f-d5ad-46d6-9746-437fab410945]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[98661284-132a-458c-b08c-9fc4089cdff6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[67872533-6de7-41ee-9fcf-2f72d7de7996]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:14:58 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:14:58 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01fa74a-fd04-4c46-8ea1-8a4a5271ee00]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG os_brick.utils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Updating existing volume attachment record: ba237388-7e19-4681-89e0-6211fdf90448 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:14:58 user nova-compute[74278]: DEBUG nova.network.neutron [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Successfully created port: a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Successfully updated port: a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquired lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-3e943c3e-2cfe-46f3-9144-ab84d7286e7e req-af55c54b-bf88-4c1d-95d0-6b4945daa915 service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Received event network-changed-a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-3e943c3e-2cfe-46f3-9144-ab84d7286e7e req-af55c54b-bf88-4c1d-95d0-6b4945daa915 service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Refreshing instance network info cache due to event network-changed-a2610d53-faf6-4587-ae34-8c28e2f02425. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e943c3e-2cfe-46f3-9144-ab84d7286e7e req-af55c54b-bf88-4c1d-95d0-6b4945daa915 service nova] Acquiring lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Updating instance_info_cache with network_info: [{"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Releasing lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Instance network_info: |[{"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e943c3e-2cfe-46f3-9144-ab84d7286e7e req-af55c54b-bf88-4c1d-95d0-6b4945daa915 service nova] Acquired lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:14:59 user nova-compute[74278]: DEBUG nova.network.neutron [req-3e943c3e-2cfe-46f3-9144-ab84d7286e7e req-af55c54b-bf88-4c1d-95d0-6b4945daa915 service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Refreshing network info cache for port a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:15:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-3e943c3e-2cfe-46f3-9144-ab84d7286e7e req-af55c54b-bf88-4c1d-95d0-6b4945daa915 service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Updated VIF entry in instance network info cache for port a2610d53-faf6-4587-ae34-8c28e2f02425. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:15:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-3e943c3e-2cfe-46f3-9144-ab84d7286e7e req-af55c54b-bf88-4c1d-95d0-6b4945daa915 service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Updating instance_info_cache with network_info: [{"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:15:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3e943c3e-2cfe-46f3-9144-ab84d7286e7e req-af55c54b-bf88-4c1d-95d0-6b4945daa915 service nova] Releasing lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:15:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:15:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:15:17 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Creating image(s)
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Ensure instance console log exists: /opt/stack/data/nova/instances/2b1e5787-b99f-4ace-9696-c1df8c0bee44/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Start _get_guest_xml network_info=[{"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPwxHhJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2b1e5787-b99f-4ace-9696-c1df8c0bee44', 'attached_at': '', 'detached_at': '', 'volume_id': '225a0e3b-f236-4849-b1e1-8e9e3b1efe8f', 'serial': '225a0e3b-f236-4849-b1e1-8e9e3b1efe8f'}, 'attachment_id': 'ba237388-7e19-4681-89e0-6211fdf90448', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:15:17 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:15:17 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPwxHhJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:15:17 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:15:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:15:17 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:15:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:15:17 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:15:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96681c3-c41b-4507-8faa-81739f7aefc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:15:17 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:15:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[597145fc-748e-4d4c-89a1-104e00dbae18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f] added
Oct 30 11:15:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a9624f-e0fd-4145-a99b-24a2e87bf3e5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[68721ac2-a314-4744-947b-9a79e85f79fb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPwxHhJe {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPwxHhJe" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da529c-ceb6-49dc-b9fd-c5c42d68d969]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kPwxHhJe'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[16294a74-2428-45a0-a8c6-69beef3a1173]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efc4f95-3cd7-4f7d-8863-ee4ec1c3cea0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:15:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:15:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca5c88c-5f3e-4f93-b4c5-4b7acd4c4a3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f, portal: 172.16.0.220,3260]
Oct 30 11:15:18 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f, portal: 172.16.0.220,3260] successful.
Oct 30 11:15:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99b0e46-0452-431f-ae6d-e982fa4f7745]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e3f1e9-9ed4-47f3-a769-a7ccc41745d5]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:15:18 user nova-compute[74278]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:15:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:15:18 user nova-compute[74278]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:15:18 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f97843f-072b-4c48-8362-47a2df3d5aff]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:18 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPwxHhJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23739366437643631', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739366437643631', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1419455301',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1419455301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1419455301',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5WFYhwLst3YoH7iDL8T8vEGMffHoPamnvJAKXkclxuQ5S3b3grejnXQImmwM2Co+fMkW21cfZxbZcmI2T6LatMyCr3jfuv84qKLCjksV10EGZngQYheWkMu2C5Qq2osA==',key_name='tempest-keypair-2005626570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-b9bdywa4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e921926b3790497fb9630088c501af82',uuid=2b1e5787-b99f-4ace-9696-c1df8c0bee44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:72:42,bridge_name='br-int',has_traffic_filtering=True,id=a2610d53-faf6-4587-ae34-8c28e2f02425,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2610d53-fa') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b1e5787-b99f-4ace-9696-c1df8c0bee44 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:15:19 user nova-compute[74278]:   <uuid>2b1e5787-b99f-4ace-9696-c1df8c0bee44</uuid>
Oct 30 11:15:19 user nova-compute[74278]:   <name>instance-0000002a</name>
Oct 30 11:15:19 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:15:19 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:15:19 user nova-compute[74278]:   <metadata>
Oct 30 11:15:19 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:15:19 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:15:19 user nova-compute[74278]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1419455301</nova:name>
Oct 30 11:15:19 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:15:17</nova:creationTime>
Oct 30 11:15:19 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:15:19 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:15:19 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:15:19 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:15:19 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:15:19 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:15:19 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:15:19 user nova-compute[74278]:       <nova:owner>
Oct 30 11:15:19 user nova-compute[74278]:         <nova:user uuid="e921926b3790497fb9630088c501af82">tempest-TestVolumeBootPattern-2008975673-project-member</nova:user>
Oct 30 11:15:19 user nova-compute[74278]:         <nova:project uuid="59235488214e4149a91d6c2d5a02dd21">tempest-TestVolumeBootPattern-2008975673</nova:project>
Oct 30 11:15:19 user nova-compute[74278]:       </nova:owner>
Oct 30 11:15:19 user nova-compute[74278]:       <nova:ports>
Oct 30 11:15:19 user nova-compute[74278]:         <nova:port uuid="a2610d53-faf6-4587-ae34-8c28e2f02425">
Oct 30 11:15:19 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 11:15:19 user nova-compute[74278]:         </nova:port>
Oct 30 11:15:19 user nova-compute[74278]:       </nova:ports>
Oct 30 11:15:19 user nova-compute[74278]:     </nova:instance>
Oct 30 11:15:19 user nova-compute[74278]:   </metadata>
Oct 30 11:15:19 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:15:19 user nova-compute[74278]:     <system>
Oct 30 11:15:19 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:15:19 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:15:19 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:15:19 user nova-compute[74278]:       <entry name="serial">2b1e5787-b99f-4ace-9696-c1df8c0bee44</entry>
Oct 30 11:15:19 user nova-compute[74278]:       <entry name="uuid">2b1e5787-b99f-4ace-9696-c1df8c0bee44</entry>
Oct 30 11:15:19 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:15:19 user nova-compute[74278]:     </system>
Oct 30 11:15:19 user nova-compute[74278]:   </sysinfo>
Oct 30 11:15:19 user nova-compute[74278]:   <os>
Oct 30 11:15:19 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:15:19 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:15:19 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:15:19 user nova-compute[74278]:   </os>
Oct 30 11:15:19 user nova-compute[74278]:   <features>
Oct 30 11:15:19 user nova-compute[74278]:     <acpi/>
Oct 30 11:15:19 user nova-compute[74278]:     <apic/>
Oct 30 11:15:19 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:15:19 user nova-compute[74278]:   </features>
Oct 30 11:15:19 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:15:19 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:15:19 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:15:19 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:15:19 user nova-compute[74278]:   </clock>
Oct 30 11:15:19 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:15:19 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:15:19 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:15:19 user nova-compute[74278]:   </cpu>
Oct 30 11:15:19 user nova-compute[74278]:   <devices>
Oct 30 11:15:19 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:15:19 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:15:19 user nova-compute[74278]:       <source dev="/dev/sdb"/>
Oct 30 11:15:19 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:15:19 user nova-compute[74278]:       <serial>225a0e3b-f236-4849-b1e1-8e9e3b1efe8f</serial>
Oct 30 11:15:19 user nova-compute[74278]:     </disk>
Oct 30 11:15:19 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:15:19 user nova-compute[74278]:       <mac address="fa:16:3e:79:72:42"/>
Oct 30 11:15:19 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:15:19 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:15:19 user nova-compute[74278]:       <target dev="tapa2610d53-fa"/>
Oct 30 11:15:19 user nova-compute[74278]:     </interface>
Oct 30 11:15:19 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:15:19 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/2b1e5787-b99f-4ace-9696-c1df8c0bee44/console.log" append="off"/>
Oct 30 11:15:19 user nova-compute[74278]:     </serial>
Oct 30 11:15:19 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:15:19 user nova-compute[74278]:     <video>
Oct 30 11:15:19 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:15:19 user nova-compute[74278]:     </video>
Oct 30 11:15:19 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:15:19 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:15:19 user nova-compute[74278]:     </rng>
Oct 30 11:15:19 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:15:19 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:15:19 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:15:19 user nova-compute[74278]:     </memballoon>
Oct 30 11:15:19 user nova-compute[74278]:   </devices>
Oct 30 11:15:19 user nova-compute[74278]: </domain>
Oct 30 11:15:19 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1419455301',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1419455301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1419455301',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5WFYhwLst3YoH7iDL8T8vEGMffHoPamnvJAKXkclxuQ5S3b3grejnXQImmwM2Co+fMkW21cfZxbZcmI2T6LatMyCr3jfuv84qKLCjksV10EGZngQYheWkMu2C5Qq2osA==',key_name='tempest-keypair-2005626570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-b9bdywa4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e921926b3790497fb9630088c501af82',uuid=2b1e5787-b99f-4ace-9696-c1df8c0bee44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:72:42,bridge_name='br-int',has_traffic_filtering=True,id=a2610d53-faf6-4587-ae34-8c28e2f02425,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2610d53-fa') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG os_vif [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:72:42,bridge_name='br-int',has_traffic_filtering=True,id=a2610d53-faf6-4587-ae34-8c28e2f02425,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2610d53-fa') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5135afaf-c22f-51d7-afc0-6993ea1cadac', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2610d53-fa, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2610d53-fa, col_values=(('qos', UUID('e8135cf9-0c5d-424f-8544-5fa8bafad96c')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2610d53-fa, col_values=(('external_ids', {'iface-id': 'a2610d53-faf6-4587-ae34-8c28e2f02425', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:72:42', 'vm-uuid': '2b1e5787-b99f-4ace-9696-c1df8c0bee44'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:19 user nova-compute[74278]: INFO os_vif [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:72:42,bridge_name='br-int',has_traffic_filtering=True,id=a2610d53-faf6-4587-ae34-8c28e2f02425,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2610d53-fa')
Oct 30 11:15:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:15:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] No VIF found with MAC fa:16:3e:79:72:42, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:15:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-78b56259-1e9d-4c27-bf5a-2726559870d2 req-4e1aa87c-b420-4b53-be5f-f67c7fee000a service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Received event network-vif-plugged-a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:15:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-78b56259-1e9d-4c27-bf5a-2726559870d2 req-4e1aa87c-b420-4b53-be5f-f67c7fee000a service nova] Acquiring lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:15:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-78b56259-1e9d-4c27-bf5a-2726559870d2 req-4e1aa87c-b420-4b53-be5f-f67c7fee000a service nova] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:15:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-78b56259-1e9d-4c27-bf5a-2726559870d2 req-4e1aa87c-b420-4b53-be5f-f67c7fee000a service nova] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:15:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-78b56259-1e9d-4c27-bf5a-2726559870d2 req-4e1aa87c-b420-4b53-be5f-f67c7fee000a service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] No waiting events found dispatching network-vif-plugged-a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:15:20 user nova-compute[74278]: WARNING nova.compute.manager [req-78b56259-1e9d-4c27-bf5a-2726559870d2 req-4e1aa87c-b420-4b53-be5f-f67c7fee000a service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Received unexpected event network-vif-plugged-a2610d53-faf6-4587-ae34-8c28e2f02425 for instance with vm_state building and task_state spawning.
Oct 30 11:15:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:22 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:15:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:15:22 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Instance spawned successfully.
Oct 30 11:15:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:15:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:15:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:15:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:15:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:15:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:15:22 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:15:23 user nova-compute[74278]: INFO nova.compute.manager [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Took 5.13 seconds to spawn the instance on the hypervisor.
Oct 30 11:15:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:15:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-9593e35e-a46f-4413-aac6-33686a43050b req-71229bbc-de46-42d3-bf17-7cfb5c2447c0 service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Received event network-vif-plugged-a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:15:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9593e35e-a46f-4413-aac6-33686a43050b req-71229bbc-de46-42d3-bf17-7cfb5c2447c0 service nova] Acquiring lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:15:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9593e35e-a46f-4413-aac6-33686a43050b req-71229bbc-de46-42d3-bf17-7cfb5c2447c0 service nova] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:15:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-9593e35e-a46f-4413-aac6-33686a43050b req-71229bbc-de46-42d3-bf17-7cfb5c2447c0 service nova] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:15:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-9593e35e-a46f-4413-aac6-33686a43050b req-71229bbc-de46-42d3-bf17-7cfb5c2447c0 service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] No waiting events found dispatching network-vif-plugged-a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:15:23 user nova-compute[74278]: WARNING nova.compute.manager [req-9593e35e-a46f-4413-aac6-33686a43050b req-71229bbc-de46-42d3-bf17-7cfb5c2447c0 service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Received unexpected event network-vif-plugged-a2610d53-faf6-4587-ae34-8c28e2f02425 for instance with vm_state building and task_state spawning.
Oct 30 11:15:23 user nova-compute[74278]: INFO nova.compute.manager [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Took 25.61 seconds to build instance.
Oct 30 11:15:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9b1213c1-9fb0-4357-9c23-448b3b8f223e tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.727s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:15:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:15:37 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:15:37 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:15:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:15:37 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:15:37 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:15:38 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating instance_info_cache with network_info: [{"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:15:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-a2cde4ee-e665-457a-b5f0-652a2c2b7f49" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:15:38 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:15:38 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:15:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:15:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:15:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:15:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:15:43 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:15:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:15:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:15:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:15:43 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:15:43 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:15:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:43 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:15:44 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:15:44 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:15:44 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8366MB free_disk=24.963516235351562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a2cde4ee-e665-457a-b5f0-652a2c2b7f49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00633014-ff03-4230-97fb-a81ce613c92d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2b1e5787-b99f-4ace-9696-c1df8c0bee44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:15:44 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:15:45 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:15:45 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:15:45 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:15:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:15:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:15:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:15:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:15:58 user nova-compute[74278]: INFO nova.compute.manager [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Terminating instance
Oct 30 11:15:58 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-8cf4fe96-6482-4af9-a9ba-c9ce470c2858 req-42a8f294-504e-4fe8-87a0-a78a377e6504 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received event network-vif-unplugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8cf4fe96-6482-4af9-a9ba-c9ce470c2858 req-42a8f294-504e-4fe8-87a0-a78a377e6504 service nova] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8cf4fe96-6482-4af9-a9ba-c9ce470c2858 req-42a8f294-504e-4fe8-87a0-a78a377e6504 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8cf4fe96-6482-4af9-a9ba-c9ce470c2858 req-42a8f294-504e-4fe8-87a0-a78a377e6504 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-8cf4fe96-6482-4af9-a9ba-c9ce470c2858 req-42a8f294-504e-4fe8-87a0-a78a377e6504 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] No waiting events found dispatching network-vif-unplugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-8cf4fe96-6482-4af9-a9ba-c9ce470c2858 req-42a8f294-504e-4fe8-87a0-a78a377e6504 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received event network-vif-unplugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:59 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Instance destroyed successfully.
Oct 30 11:15:59 user nova-compute[74278]: DEBUG nova.objects.instance [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lazy-loading 'resources' on Instance uuid a2cde4ee-e665-457a-b5f0-652a2c2b7f49 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:09:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-238911529',display_name='tempest-ServerActionsTestOtherA-server-238911529',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-238911529',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+yfE1fzC0NeFR+gspIaPJ/CcDdqYlrTD1/gMueYz50h0LQsw5TCBiSQS0P2divdfLo9Fj2hNvf4LMgeazslsUbDPOdzcoch9KTxV2Qpnb5QJ+Ahxn1Nm/kcqA+i5KG3A==',key_name='tempest-keypair-148099064',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:11:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-zwruvzc8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=a2cde4ee-e665-457a-b5f0-652a2c2b7f49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "address": "fa:16:3e:57:29:0b", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de72719-56", "ovs_interfaceid": "8de72719-56c4-4be2-b3f6-f4207ae8f395", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_vif [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8de72719-56, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79ee71fd-1002-4955-9186-cb1a101494e1) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:15:59 user nova-compute[74278]: INFO os_vif [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:29:0b,bridge_name='br-int',has_traffic_filtering=True,id=8de72719-56c4-4be2-b3f6-f4207ae8f395,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de72719-56')
Oct 30 11:15:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GXBJdloE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:15:59 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e3b16e-318f-4552-93b5-2f020f57d23a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:15:59 user nova-compute[74278]: No targets found.
Oct 30 11:15:59 user nova-compute[74278]: iSNS:
Oct 30 11:15:59 user nova-compute[74278]: No targets found.
Oct 30 11:15:59 user nova-compute[74278]: STATIC:
Oct 30 11:15:59 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f
Oct 30 11:15:59 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:15:59 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:15:59 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f
Oct 30 11:15:59 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:15:59 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:15:59 user nova-compute[74278]: FIRMWARE:
Oct 30 11:15:59 user nova-compute[74278]: No targets found.
Oct 30 11:15:59 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:15:59 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:15:59 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8e5d21-a07e-4437-96d8-d81de21e680a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf5cb85-01db-4ea2-9cd5-8870f141dac2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:15:59 user nova-compute[74278]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:15:59 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f (non-flash)
Oct 30 11:15:59 user nova-compute[74278]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:15:59 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c3aba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75d5bae-b5d9-4cb6-9b1f-cc2b5b60a8e3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1d2232-3ac3-47d2-ae01-9801f7fc7b45]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[406f03cb-49cd-47f5-8239-af636fdfb04a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abba403-0116-463e-9870-8e7b70d8d185]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1b3d1334', '/dev/disk/by-id/scsi-1SCST_BIO1b3d1334-ec5a7626934f4017', '/dev/disk/by-id/scsi-26563356137363236') {{(pid=85487) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da7c7d8-c1fc-4954-b0e6-7ac6bcd764bf]: (4, None) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67f3eb1-419e-4e1e-9ff9-55e1e0e3571b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[73434e66-df7d-4d88-822b-91921e63c261]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260]
Oct 30 11:15:59 user nova-compute[74278]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f, portal: 172.16.0.220,3260] successful.
Oct 30 11:15:59 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32a94a98-5e5d-4bde-89ad-576a82f2060f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93b5b04-4e0a-4f39-a59f-f329542fdb92]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] <== disconnect_volume: return (334ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:15:59 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Deleting instance files /opt/stack/data/nova/instances/a2cde4ee-e665-457a-b5f0-652a2c2b7f49_del
Oct 30 11:15:59 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Deletion of /opt/stack/data/nova/instances/a2cde4ee-e665-457a-b5f0-652a2c2b7f49_del complete
Oct 30 11:15:59 user nova-compute[74278]: INFO nova.compute.manager [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 30 11:15:59 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:15:59 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:16:00 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:16:00 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Took 0.83 seconds to deallocate network for instance.
Oct 30 11:16:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-e14729aa-737c-4a6e-850b-217838ef9552 req-d648ad5d-8e31-4361-85d5-7223f4dd1d53 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received event network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:16:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e14729aa-737c-4a6e-850b-217838ef9552 req-d648ad5d-8e31-4361-85d5-7223f4dd1d53 service nova] Acquiring lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:16:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e14729aa-737c-4a6e-850b-217838ef9552 req-d648ad5d-8e31-4361-85d5-7223f4dd1d53 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:16:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e14729aa-737c-4a6e-850b-217838ef9552 req-d648ad5d-8e31-4361-85d5-7223f4dd1d53 service nova] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:16:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-e14729aa-737c-4a6e-850b-217838ef9552 req-d648ad5d-8e31-4361-85d5-7223f4dd1d53 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] No waiting events found dispatching network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:16:00 user nova-compute[74278]: WARNING nova.compute.manager [req-e14729aa-737c-4a6e-850b-217838ef9552 req-d648ad5d-8e31-4361-85d5-7223f4dd1d53 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received unexpected event network-vif-plugged-8de72719-56c4-4be2-b3f6-f4207ae8f395 for instance with vm_state active and task_state deleting.
Oct 30 11:16:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-e14729aa-737c-4a6e-850b-217838ef9552 req-d648ad5d-8e31-4361-85d5-7223f4dd1d53 service nova] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Received event network-vif-deleted-8de72719-56c4-4be2-b3f6-f4207ae8f395 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:16:01 user nova-compute[74278]: INFO nova.compute.manager [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Took 0.87 seconds to detach 1 volumes for instance.
Oct 30 11:16:01 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: a2cde4ee-e665-457a-b5f0-652a2c2b7f49] Deleting volume: 32a94a98-5e5d-4bde-89ad-576a82f2060f {{(pid=74278) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 11:16:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:16:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:16:01 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:16:01 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:16:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:16:01 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Deleted allocations for instance a2cde4ee-e665-457a-b5f0-652a2c2b7f49
Oct 30 11:16:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b5ebd063-654a-49f3-aa35-b30f9d92423d tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "a2cde4ee-e665-457a-b5f0-652a2c2b7f49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.381s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:16:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-91cf529c-1a23-4d11-a143-ecc6c448f5c6 req-57778d19-a381-4656-9a7e-51cad0cc1839 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Received event network-changed-89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-91cf529c-1a23-4d11-a143-ecc6c448f5c6 req-57778d19-a381-4656-9a7e-51cad0cc1839 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Refreshing instance network info cache due to event network-changed-89b53b4f-7677-4b8f-9253-14b9d6091ea2. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-91cf529c-1a23-4d11-a143-ecc6c448f5c6 req-57778d19-a381-4656-9a7e-51cad0cc1839 service nova] Acquiring lock "refresh_cache-00633014-ff03-4230-97fb-a81ce613c92d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-91cf529c-1a23-4d11-a143-ecc6c448f5c6 req-57778d19-a381-4656-9a7e-51cad0cc1839 service nova] Acquired lock "refresh_cache-00633014-ff03-4230-97fb-a81ce613c92d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-91cf529c-1a23-4d11-a143-ecc6c448f5c6 req-57778d19-a381-4656-9a7e-51cad0cc1839 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Refreshing network info cache for port 89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "00633014-ff03-4230-97fb-a81ce613c92d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "00633014-ff03-4230-97fb-a81ce613c92d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG nova.objects.instance [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lazy-loading 'flavor' on Instance uuid 00633014-ff03-4230-97fb-a81ce613c92d {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:16:14 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Ignoring supplied device name: /dev/vdb
Oct 30 11:16:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "00633014-ff03-4230-97fb-a81ce613c92d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-91cf529c-1a23-4d11-a143-ecc6c448f5c6 req-57778d19-a381-4656-9a7e-51cad0cc1839 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Updated VIF entry in instance network info cache for port 89b53b4f-7677-4b8f-9253-14b9d6091ea2. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-91cf529c-1a23-4d11-a143-ecc6c448f5c6 req-57778d19-a381-4656-9a7e-51cad0cc1839 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Updating instance_info_cache with network_info: [{"id": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "address": "fa:16:3e:be:97:6d", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b53b4f-76", "ovs_interfaceid": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "00633014-ff03-4230-97fb-a81ce613c92d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:16:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "00633014-ff03-4230-97fb-a81ce613c92d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:16:14 user nova-compute[74278]: INFO nova.compute.manager [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Attaching volume b61e991d-4265-4270-8037-59dbf3d9af2a to /dev/vdb
Oct 30 11:16:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-91cf529c-1a23-4d11-a143-ecc6c448f5c6 req-57778d19-a381-4656-9a7e-51cad0cc1839 service nova] Releasing lock "refresh_cache-00633014-ff03-4230-97fb-a81ce613c92d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG os_brick.utils [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd029d4-c849-4160-b25a-8c4f5e8b0041]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f05837-9e25-4545-b49a-96763cd860b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae070bc-500a-455e-9675-ffd71bdbe55d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4b0e48-a5d2-45e7-a3fd-654afb9e3ab7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:16:15 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:16:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8184a39b-1887-4a6e-be0d-7fb41792a4a5]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG os_brick.utils [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Updating existing volume attachment record: 8cdfb2f5-73b8-4ad8-8958-16ca0a6f8a11 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:16:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQCrUgLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:16:34 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:16:34 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:16:34 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[25baf43a-fb1b-4bef-87fa-9a4f6accf2a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:16:34 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbbdb96-9e86-476b-a64a-42f4ce101262]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a] added
Oct 30 11:16:34 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e5068b-5ae6-448f-8564-4ba336ad153a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dff7a9a-601d-4561-a34d-b3546dfbbe51]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RQCrUgLV {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RQCrUgLV" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[012660f2-ad88-430d-927d-260ca333d74c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RQCrUgLV'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3c744a-436b-4b05-b0cc-a27f29242376]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[932a0192-42f8-4f4f-becc-91b7ba813057]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:16:34 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:16:34 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a13696-9dbe-49cb-940f-62506e8f0332]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a, portal: 172.16.0.220,3260]
Oct 30 11:16:34 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a, portal: 172.16.0.220,3260] successful.
Oct 30 11:16:34 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6e2fbd-bc56-40b6-ada9-b0733f702615]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[235dfb3b-5729-4c20-825d-0b5d902cb9a4]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:16:34 user nova-compute[74278]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a (non-flash)
Oct 30 11:16:34 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:16:34 user nova-compute[74278]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a (non-flash)
Oct 30 11:16:34 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe40e727-4e79-4794-b755-de6adb03c1bc]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:16:34 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:16:35 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:16:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQCrUgLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:16:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:16:35 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23066383361666234', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:16:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066383361666234', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:16:35 user nova-compute[74278]: DEBUG nova.objects.instance [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lazy-loading 'flavor' on Instance uuid 00633014-ff03-4230-97fb-a81ce613c92d {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:16:35 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:16:35 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:16:35 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:16:35 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:16:35 user nova-compute[74278]:   <serial>b61e991d-4265-4270-8037-59dbf3d9af2a</serial>
Oct 30 11:16:35 user nova-compute[74278]: </disk>
Oct 30 11:16:35 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:16:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:16:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:16:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] No VIF found with MAC fa:16:3e:be:97:6d, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:16:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5d101d47-1d5b-451b-befa-b5bcb6fa114c tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "00633014-ff03-4230-97fb-a81ce613c92d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.722s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:16:38 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:38 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:16:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-00633014-ff03-4230-97fb-a81ce613c92d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:16:38 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-00633014-ff03-4230-97fb-a81ce613c92d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:16:38 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:16:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:16:39 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Updating instance_info_cache with network_info: [{"id": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "address": "fa:16:3e:be:97:6d", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b53b4f-76", "ovs_interfaceid": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:16:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-00633014-ff03-4230-97fb-a81ce613c92d" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:16:39 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:16:39 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:16:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:16:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:16:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:16:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:45 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:16:45 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:16:45 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8531MB free_disk=24.959964752197266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:16:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:16:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 65466a3f-2824-4172-a3c2-8fba650788e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00633014-ff03-4230-97fb-a81ce613c92d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2b1e5787-b99f-4ace-9696-c1df8c0bee44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing inventories for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating ProviderTree inventory for provider ce405684-67ab-45d9-bc83-6af4903bfb15 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating inventory in ProviderTree for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing aggregate associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, aggregates: None {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing trait associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:16:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.704s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:16:48 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-8513d755-6e82-45ee-9f48-4986cd36759a req-5bdd2aa9-5709-4311-8e85-de246a23a75a service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Received event network-changed-a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:16:48 user nova-compute[74278]: DEBUG nova.compute.manager [req-8513d755-6e82-45ee-9f48-4986cd36759a req-5bdd2aa9-5709-4311-8e85-de246a23a75a service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Refreshing instance network info cache due to event network-changed-a2610d53-faf6-4587-ae34-8c28e2f02425. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:16:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8513d755-6e82-45ee-9f48-4986cd36759a req-5bdd2aa9-5709-4311-8e85-de246a23a75a service nova] Acquiring lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:16:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8513d755-6e82-45ee-9f48-4986cd36759a req-5bdd2aa9-5709-4311-8e85-de246a23a75a service nova] Acquired lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:16:48 user nova-compute[74278]: DEBUG nova.network.neutron [req-8513d755-6e82-45ee-9f48-4986cd36759a req-5bdd2aa9-5709-4311-8e85-de246a23a75a service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Refreshing network info cache for port a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:16:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:49 user nova-compute[74278]: DEBUG nova.network.neutron [req-8513d755-6e82-45ee-9f48-4986cd36759a req-5bdd2aa9-5709-4311-8e85-de246a23a75a service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Updated VIF entry in instance network info cache for port a2610d53-faf6-4587-ae34-8c28e2f02425. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:16:49 user nova-compute[74278]: DEBUG nova.network.neutron [req-8513d755-6e82-45ee-9f48-4986cd36759a req-5bdd2aa9-5709-4311-8e85-de246a23a75a service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Updating instance_info_cache with network_info: [{"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:16:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8513d755-6e82-45ee-9f48-4986cd36759a req-5bdd2aa9-5709-4311-8e85-de246a23a75a service nova] Releasing lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:16:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:51 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:53 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74278) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 11:16:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:56 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:16:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 11:16:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] There are 0 instances to clean {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 11:16:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:16:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 65466a3f-2824-4172-a3c2-8fba650788e9 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 00633014-ff03-4230-97fb-a81ce613c92d {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 2b1e5787-b99f-4ace-9696-c1df8c0bee44 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "65466a3f-2824-4172-a3c2-8fba650788e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "65466a3f-2824-4172-a3c2-8fba650788e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "00633014-ff03-4230-97fb-a81ce613c92d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "00633014-ff03-4230-97fb-a81ce613c92d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "00633014-ff03-4230-97fb-a81ce613c92d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "65466a3f-2824-4172-a3c2-8fba650788e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:17:04 user nova-compute[74278]: INFO nova.compute.claims [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Claim successful on node user
Oct 30 11:17:04 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:17:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:17:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG nova.network.neutron [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:17:04 user nova-compute[74278]: DEBUG nova.policy [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e921926b3790497fb9630088c501af82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59235488214e4149a91d6c2d5a02dd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:17:04 user nova-compute[74278]: INFO nova.virt.block_device [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Booting with volume snapshot 2f6a575b-3d74-43e2-a0bc-e8df1d126fb6 at /dev/vda
Oct 30 11:17:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Successfully created port: 6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:17:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Successfully updated port: 6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:17:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "refresh_cache-0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:17:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquired lock "refresh_cache-0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:17:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:17:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-95c86c8a-5c90-4b9a-9eb1-fba6fc42078c req-b9d85f94-cd38-47c1-83ad-5132b445b39f service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Received event network-changed-6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:17:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-95c86c8a-5c90-4b9a-9eb1-fba6fc42078c req-b9d85f94-cd38-47c1-83ad-5132b445b39f service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Refreshing instance network info cache due to event network-changed-6051f9bc-97da-4051-bb78-51e4f3227523. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:17:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-95c86c8a-5c90-4b9a-9eb1-fba6fc42078c req-b9d85f94-cd38-47c1-83ad-5132b445b39f service nova] Acquiring lock "refresh_cache-0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:17:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:17:07 user nova-compute[74278]: DEBUG nova.network.neutron [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Updating instance_info_cache with network_info: [{"id": "6051f9bc-97da-4051-bb78-51e4f3227523", "address": "fa:16:3e:ba:40:47", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6051f9bc-97", "ovs_interfaceid": "6051f9bc-97da-4051-bb78-51e4f3227523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:17:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Releasing lock "refresh_cache-0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:17:07 user nova-compute[74278]: DEBUG nova.compute.manager [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Instance network_info: |[{"id": "6051f9bc-97da-4051-bb78-51e4f3227523", "address": "fa:16:3e:ba:40:47", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6051f9bc-97", "ovs_interfaceid": "6051f9bc-97da-4051-bb78-51e4f3227523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:17:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-95c86c8a-5c90-4b9a-9eb1-fba6fc42078c req-b9d85f94-cd38-47c1-83ad-5132b445b39f service nova] Acquired lock "refresh_cache-0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:17:07 user nova-compute[74278]: DEBUG nova.network.neutron [req-95c86c8a-5c90-4b9a-9eb1-fba6fc42078c req-b9d85f94-cd38-47c1-83ad-5132b445b39f service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Refreshing network info cache for port 6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:17:07 user nova-compute[74278]: DEBUG nova.network.neutron [req-95c86c8a-5c90-4b9a-9eb1-fba6fc42078c req-b9d85f94-cd38-47c1-83ad-5132b445b39f service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Updated VIF entry in instance network info cache for port 6051f9bc-97da-4051-bb78-51e4f3227523. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:17:07 user nova-compute[74278]: DEBUG nova.network.neutron [req-95c86c8a-5c90-4b9a-9eb1-fba6fc42078c req-b9d85f94-cd38-47c1-83ad-5132b445b39f service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Updating instance_info_cache with network_info: [{"id": "6051f9bc-97da-4051-bb78-51e4f3227523", "address": "fa:16:3e:ba:40:47", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6051f9bc-97", "ovs_interfaceid": "6051f9bc-97da-4051-bb78-51e4f3227523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:17:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-95c86c8a-5c90-4b9a-9eb1-fba6fc42078c req-b9d85f94-cd38-47c1-83ad-5132b445b39f service nova] Releasing lock "refresh_cache-0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:17:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "65466a3f-2824-4172-a3c2-8fba650788e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "65466a3f-2824-4172-a3c2-8fba650788e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:11 user nova-compute[74278]: INFO nova.compute.manager [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Terminating instance
Oct 30 11:17:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:17:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-f68a0c7d-6ac0-478b-bea9-3651da34f8f1 req-8b8b2f60-0a05-41df-b6c3-feccb4413e52 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received event network-vif-unplugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f68a0c7d-6ac0-478b-bea9-3651da34f8f1 req-8b8b2f60-0a05-41df-b6c3-feccb4413e52 service nova] Acquiring lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f68a0c7d-6ac0-478b-bea9-3651da34f8f1 req-8b8b2f60-0a05-41df-b6c3-feccb4413e52 service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f68a0c7d-6ac0-478b-bea9-3651da34f8f1 req-8b8b2f60-0a05-41df-b6c3-feccb4413e52 service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-f68a0c7d-6ac0-478b-bea9-3651da34f8f1 req-8b8b2f60-0a05-41df-b6c3-feccb4413e52 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] No waiting events found dispatching network-vif-unplugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-f68a0c7d-6ac0-478b-bea9-3651da34f8f1 req-8b8b2f60-0a05-41df-b6c3-feccb4413e52 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received event network-vif-unplugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:17:12 user nova-compute[74278]: INFO nova.compute.claims [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Claim successful on node user
Oct 30 11:17:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:12 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Instance destroyed successfully.
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.objects.instance [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lazy-loading 'resources' on Instance uuid 65466a3f-2824-4172-a3c2-8fba650788e9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T10:57:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-792826486',display_name='tempest-ServerActionsTestOtherA-server-792826486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-792826486',id=19,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+yfE1fzC0NeFR+gspIaPJ/CcDdqYlrTD1/gMueYz50h0LQsw5TCBiSQS0P2divdfLo9Fj2hNvf4LMgeazslsUbDPOdzcoch9KTxV2Qpnb5QJ+Ahxn1Nm/kcqA+i5KG3A==',key_name='tempest-keypair-148099064',keypairs=<?>,launch_index=0,launched_at=2023-10-30T10:57:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d8215346d10443799d5d450114b09386',ramdisk_id='',reservation_id='r-rlmf0hdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1217247754',owner_user_name='tempest-ServerActionsTestOtherA-1217247754-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T10:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b9a38bd9c4e4717b9499ed404ed2d6d',uuid=65466a3f-2824-4172-a3c2-8fba650788e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converting VIF {"id": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "address": "fa:16:3e:6a:72:fc", "network": {"id": "12487675-f087-412b-b399-e5a88cf2b99e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-346429249-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d8215346d10443799d5d450114b09386", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b94215b-9b", "ovs_interfaceid": "2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b94215b-9b') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG os_vif [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b94215b-9b') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b94215b-9b, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=169aff13-bc08-4630-b52b-1440cb92018a) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:17:12 user nova-compute[74278]: INFO os_vif [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4,network=Network(12487675-f087-412b-b399-e5a88cf2b99e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b94215b-9b')
Oct 30 11:17:12 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Deleting instance files /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9_del
Oct 30 11:17:12 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Deletion of /opt/stack/data/nova/instances/65466a3f-2824-4172-a3c2-8fba650788e9_del complete
Oct 30 11:17:12 user nova-compute[74278]: INFO nova.compute.manager [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 30 11:17:12 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:17:12 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:17:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG nova.policy [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '83ae50730c1043e4bd50a078f50d9a4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18ced034d3e435c9c8b0062a18b01e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:17:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Creating image(s)
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "/opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "/opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "/opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.205s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.185s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk 1073741824" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.369s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:13 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Successfully created port: 145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.249s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received event network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] Acquiring lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] No waiting events found dispatching network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:17:14 user nova-compute[74278]: WARNING nova.compute.manager [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received unexpected event network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 for instance with vm_state active and task_state deleting.
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received event network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] Acquiring lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] No waiting events found dispatching network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:17:14 user nova-compute[74278]: WARNING nova.compute.manager [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received unexpected event network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 for instance with vm_state active and task_state deleting.
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received event network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] Acquiring lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] No waiting events found dispatching network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:17:14 user nova-compute[74278]: WARNING nova.compute.manager [req-8c51d888-b824-474c-8531-89b2c24422d4 req-7ab90f7b-90b1-44b7-b47e-ec507274c4ac service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received unexpected event network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 for instance with vm_state active and task_state deleting.
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:17:14 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Took 1.50 seconds to deallocate network for instance.
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Cannot resize image /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Ensure instance console log exists: /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:14 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Deleted allocations for instance 65466a3f-2824-4172-a3c2-8fba650788e9
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Successfully updated port: 145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquired lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6f5067f9-783d-463c-a1d1-876c653be19b tempest-ServerActionsTestOtherA-1217247754 tempest-ServerActionsTestOtherA-1217247754-project-member] Lock "65466a3f-2824-4172-a3c2-8fba650788e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.059s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-60b576ae-aad2-415f-a4f7-d20ed694998c req-87032b79-3e23-4230-b7b2-d5ce58b04964 service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Received event network-changed-145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-60b576ae-aad2-415f-a4f7-d20ed694998c req-87032b79-3e23-4230-b7b2-d5ce58b04964 service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Refreshing instance network info cache due to event network-changed-145199b0-d3de-4607-949f-16e697b9b1db. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-60b576ae-aad2-415f-a4f7-d20ed694998c req-87032b79-3e23-4230-b7b2-d5ce58b04964 service nova] Acquiring lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:17:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updating instance_info_cache with network_info: [{"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Releasing lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Instance network_info: |[{"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-60b576ae-aad2-415f-a4f7-d20ed694998c req-87032b79-3e23-4230-b7b2-d5ce58b04964 service nova] Acquired lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-60b576ae-aad2-415f-a4f7-d20ed694998c req-87032b79-3e23-4230-b7b2-d5ce58b04964 service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Refreshing network info cache for port 145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Start _get_guest_xml network_info=[{"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:17:15 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:17:15 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1725281181',display_name='tempest-SnapshotDataIntegrityTests-server-1725281181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1725281181',id=44,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9Byoa08RcTocpOCS7eBZw0ROb3iNzcjSsXh1RNbfUv0xUPRfDGzKDJIOEG24i/6NMIQAirPudo/Jve9BevNDyHDt4iwT0XM0zo/clZL1twY6ugVROhIOZhddl9EPUrMQ==',key_name='tempest-keypair-654091655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a18ced034d3e435c9c8b0062a18b01e5',ramdisk_id='',reservation_id='r-mucb8x39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-21329946',owner_user_name='tempest-SnapshotDataIntegrityTests-21329946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ae50730c1043e4bd50a078f50d9a4a',uuid=4338fbe0-d9f1-4425-a2fc-72c78d4bce34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Converting VIF {"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:ad:9d,bridge_name='br-int',has_traffic_filtering=True,id=145199b0-d3de-4607-949f-16e697b9b1db,network=Network(a7fa42d1-654d-4864-9899-ae773e50243b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145199b0-d3') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.objects.instance [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'pci_devices' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:17:15 user nova-compute[74278]:   <uuid>4338fbe0-d9f1-4425-a2fc-72c78d4bce34</uuid>
Oct 30 11:17:15 user nova-compute[74278]:   <name>instance-0000002c</name>
Oct 30 11:17:15 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:17:15 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:17:15 user nova-compute[74278]:   <metadata>
Oct 30 11:17:15 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:17:15 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:17:15 user nova-compute[74278]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1725281181</nova:name>
Oct 30 11:17:15 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:17:15</nova:creationTime>
Oct 30 11:17:15 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:17:15 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:17:15 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:17:15 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:17:15 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:17:15 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:17:15 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:17:15 user nova-compute[74278]:       <nova:owner>
Oct 30 11:17:15 user nova-compute[74278]:         <nova:user uuid="83ae50730c1043e4bd50a078f50d9a4a">tempest-SnapshotDataIntegrityTests-21329946-project-member</nova:user>
Oct 30 11:17:15 user nova-compute[74278]:         <nova:project uuid="a18ced034d3e435c9c8b0062a18b01e5">tempest-SnapshotDataIntegrityTests-21329946</nova:project>
Oct 30 11:17:15 user nova-compute[74278]:       </nova:owner>
Oct 30 11:17:15 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:17:15 user nova-compute[74278]:       <nova:ports>
Oct 30 11:17:15 user nova-compute[74278]:         <nova:port uuid="145199b0-d3de-4607-949f-16e697b9b1db">
Oct 30 11:17:15 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 11:17:15 user nova-compute[74278]:         </nova:port>
Oct 30 11:17:15 user nova-compute[74278]:       </nova:ports>
Oct 30 11:17:15 user nova-compute[74278]:     </nova:instance>
Oct 30 11:17:15 user nova-compute[74278]:   </metadata>
Oct 30 11:17:15 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:17:15 user nova-compute[74278]:     <system>
Oct 30 11:17:15 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:17:15 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:17:15 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:17:15 user nova-compute[74278]:       <entry name="serial">4338fbe0-d9f1-4425-a2fc-72c78d4bce34</entry>
Oct 30 11:17:15 user nova-compute[74278]:       <entry name="uuid">4338fbe0-d9f1-4425-a2fc-72c78d4bce34</entry>
Oct 30 11:17:15 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:17:15 user nova-compute[74278]:     </system>
Oct 30 11:17:15 user nova-compute[74278]:   </sysinfo>
Oct 30 11:17:15 user nova-compute[74278]:   <os>
Oct 30 11:17:15 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:17:15 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:17:15 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:17:15 user nova-compute[74278]:   </os>
Oct 30 11:17:15 user nova-compute[74278]:   <features>
Oct 30 11:17:15 user nova-compute[74278]:     <acpi/>
Oct 30 11:17:15 user nova-compute[74278]:     <apic/>
Oct 30 11:17:15 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:17:15 user nova-compute[74278]:   </features>
Oct 30 11:17:15 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:17:15 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:17:15 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:17:15 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:17:15 user nova-compute[74278]:   </clock>
Oct 30 11:17:15 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:17:15 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:17:15 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:17:15 user nova-compute[74278]:   </cpu>
Oct 30 11:17:15 user nova-compute[74278]:   <devices>
Oct 30 11:17:15 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:17:15 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:17:15 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk"/>
Oct 30 11:17:15 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:17:15 user nova-compute[74278]:     </disk>
Oct 30 11:17:15 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:17:15 user nova-compute[74278]:       <mac address="fa:16:3e:91:ad:9d"/>
Oct 30 11:17:15 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:17:15 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:17:15 user nova-compute[74278]:       <target dev="tap145199b0-d3"/>
Oct 30 11:17:15 user nova-compute[74278]:     </interface>
Oct 30 11:17:15 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:17:15 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/console.log" append="off"/>
Oct 30 11:17:15 user nova-compute[74278]:     </serial>
Oct 30 11:17:15 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:17:15 user nova-compute[74278]:     <video>
Oct 30 11:17:15 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:17:15 user nova-compute[74278]:     </video>
Oct 30 11:17:15 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:17:15 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:17:15 user nova-compute[74278]:     </rng>
Oct 30 11:17:15 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:17:15 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:17:15 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:17:15 user nova-compute[74278]:     </memballoon>
Oct 30 11:17:15 user nova-compute[74278]:   </devices>
Oct 30 11:17:15 user nova-compute[74278]: </domain>
Oct 30 11:17:15 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1725281181',display_name='tempest-SnapshotDataIntegrityTests-server-1725281181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1725281181',id=44,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9Byoa08RcTocpOCS7eBZw0ROb3iNzcjSsXh1RNbfUv0xUPRfDGzKDJIOEG24i/6NMIQAirPudo/Jve9BevNDyHDt4iwT0XM0zo/clZL1twY6ugVROhIOZhddl9EPUrMQ==',key_name='tempest-keypair-654091655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a18ced034d3e435c9c8b0062a18b01e5',ramdisk_id='',reservation_id='r-mucb8x39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-21329946',owner_user_name='tempest-SnapshotDataIntegrityTests-21329946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ae50730c1043e4bd50a078f50d9a4a',uuid=4338fbe0-d9f1-4425-a2fc-72c78d4bce34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Converting VIF {"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:ad:9d,bridge_name='br-int',has_traffic_filtering=True,id=145199b0-d3de-4607-949f-16e697b9b1db,network=Network(a7fa42d1-654d-4864-9899-ae773e50243b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145199b0-d3') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG os_vif [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:ad:9d,bridge_name='br-int',has_traffic_filtering=True,id=145199b0-d3de-4607-949f-16e697b9b1db,network=Network(a7fa42d1-654d-4864-9899-ae773e50243b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145199b0-d3') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47e1ea6f-c1f1-55d5-a7ab-f4ddad61025a', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap145199b0-d3, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap145199b0-d3, col_values=(('qos', UUID('1dd814e9-5623-4f4c-a6e4-bf79b1283ae6')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap145199b0-d3, col_values=(('external_ids', {'iface-id': '145199b0-d3de-4607-949f-16e697b9b1db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:ad:9d', 'vm-uuid': '4338fbe0-d9f1-4425-a2fc-72c78d4bce34'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:15 user nova-compute[74278]: INFO os_vif [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:ad:9d,bridge_name='br-int',has_traffic_filtering=True,id=145199b0-d3de-4607-949f-16e697b9b1db,network=Network(a7fa42d1-654d-4864-9899-ae773e50243b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145199b0-d3')
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No VIF found with MAC fa:16:3e:91:ad:9d, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG os_brick.utils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a52e0dd-27dc-4033-8da7-43a52f084d4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dec73f-570f-48c0-88bd-c20e6a64f4e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcae66a-bf22-4cbb-9d54-065af8267626]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab3df0c-f56a-4bdf-bfb3-d68892a53217]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:17:15 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:17:15 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b599e43-b3fb-4ffd-b0f7-fc6d58073817]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG os_brick.utils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:17:15 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Updating existing volume attachment record: d4a1a487-5922-4a7f-bbda-8769cfb6dda5 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:17:16 user nova-compute[74278]: DEBUG nova.network.neutron [req-60b576ae-aad2-415f-a4f7-d20ed694998c req-87032b79-3e23-4230-b7b2-d5ce58b04964 service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updated VIF entry in instance network info cache for port 145199b0-d3de-4607-949f-16e697b9b1db. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:17:16 user nova-compute[74278]: DEBUG nova.network.neutron [req-60b576ae-aad2-415f-a4f7-d20ed694998c req-87032b79-3e23-4230-b7b2-d5ce58b04964 service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updating instance_info_cache with network_info: [{"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:17:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-60b576ae-aad2-415f-a4f7-d20ed694998c req-87032b79-3e23-4230-b7b2-d5ce58b04964 service nova] Releasing lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:17:16 user nova-compute[74278]: DEBUG nova.compute.manager [req-5303eac2-2ea0-4292-8b89-b8b0ed8687dc req-9647d831-c30c-4eba-8a01-b9ee462a6005 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received event network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:17:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5303eac2-2ea0-4292-8b89-b8b0ed8687dc req-9647d831-c30c-4eba-8a01-b9ee462a6005 service nova] Acquiring lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5303eac2-2ea0-4292-8b89-b8b0ed8687dc req-9647d831-c30c-4eba-8a01-b9ee462a6005 service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5303eac2-2ea0-4292-8b89-b8b0ed8687dc req-9647d831-c30c-4eba-8a01-b9ee462a6005 service nova] Lock "65466a3f-2824-4172-a3c2-8fba650788e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:16 user nova-compute[74278]: DEBUG nova.compute.manager [req-5303eac2-2ea0-4292-8b89-b8b0ed8687dc req-9647d831-c30c-4eba-8a01-b9ee462a6005 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] No waiting events found dispatching network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:17:16 user nova-compute[74278]: WARNING nova.compute.manager [req-5303eac2-2ea0-4292-8b89-b8b0ed8687dc req-9647d831-c30c-4eba-8a01-b9ee462a6005 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received unexpected event network-vif-plugged-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 for instance with vm_state deleted and task_state None.
Oct 30 11:17:16 user nova-compute[74278]: DEBUG nova.compute.manager [req-5303eac2-2ea0-4292-8b89-b8b0ed8687dc req-9647d831-c30c-4eba-8a01-b9ee462a6005 service nova] [instance: 65466a3f-2824-4172-a3c2-8fba650788e9] Received event network-vif-deleted-2b94215b-9b6c-4f0a-a85f-8ca97ed2d0d4 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:17:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-a66c728f-2002-4a86-b5f1-2c4328c4e794 req-f072642a-86ae-49e8-b880-9e017909ecd6 service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Received event network-vif-plugged-145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:17:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a66c728f-2002-4a86-b5f1-2c4328c4e794 req-f072642a-86ae-49e8-b880-9e017909ecd6 service nova] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a66c728f-2002-4a86-b5f1-2c4328c4e794 req-f072642a-86ae-49e8-b880-9e017909ecd6 service nova] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a66c728f-2002-4a86-b5f1-2c4328c4e794 req-f072642a-86ae-49e8-b880-9e017909ecd6 service nova] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-a66c728f-2002-4a86-b5f1-2c4328c4e794 req-f072642a-86ae-49e8-b880-9e017909ecd6 service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] No waiting events found dispatching network-vif-plugged-145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:17:17 user nova-compute[74278]: WARNING nova.compute.manager [req-a66c728f-2002-4a86-b5f1-2c4328c4e794 req-f072642a-86ae-49e8-b880-9e017909ecd6 service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Received unexpected event network-vif-plugged-145199b0-d3de-4607-949f-16e697b9b1db for instance with vm_state building and task_state spawning.
Oct 30 11:17:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:19 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:17:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:17:19 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Instance spawned successfully.
Oct 30 11:17:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:17:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-a7017672-c6ee-4719-a7d6-ae7c02506d58 req-6078de78-3d9e-4401-9e25-6734900a22ff service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Received event network-vif-plugged-145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:17:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a7017672-c6ee-4719-a7d6-ae7c02506d58 req-6078de78-3d9e-4401-9e25-6734900a22ff service nova] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a7017672-c6ee-4719-a7d6-ae7c02506d58 req-6078de78-3d9e-4401-9e25-6734900a22ff service nova] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a7017672-c6ee-4719-a7d6-ae7c02506d58 req-6078de78-3d9e-4401-9e25-6734900a22ff service nova] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:19 user nova-compute[74278]: DEBUG nova.compute.manager [req-a7017672-c6ee-4719-a7d6-ae7c02506d58 req-6078de78-3d9e-4401-9e25-6734900a22ff service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] No waiting events found dispatching network-vif-plugged-145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:17:19 user nova-compute[74278]: WARNING nova.compute.manager [req-a7017672-c6ee-4719-a7d6-ae7c02506d58 req-6078de78-3d9e-4401-9e25-6734900a22ff service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Received unexpected event network-vif-plugged-145199b0-d3de-4607-949f-16e697b9b1db for instance with vm_state building and task_state spawning.
Oct 30 11:17:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:17:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:17:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:17:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:17:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:17:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:17:19 user nova-compute[74278]: INFO nova.compute.manager [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Took 6.05 seconds to spawn the instance on the hypervisor.
Oct 30 11:17:19 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:17:19 user nova-compute[74278]: INFO nova.compute.manager [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Took 7.00 seconds to build instance.
Oct 30 11:17:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b263f811-0651-4974-b392-b1572bcdad52 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.109s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:17:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:17:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:17:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:17:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:17:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "00633014-ff03-4230-97fb-a81ce613c92d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "00633014-ff03-4230-97fb-a81ce613c92d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:36 user nova-compute[74278]: INFO nova.compute.manager [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Detaching volume b61e991d-4265-4270-8037-59dbf3d9af2a
Oct 30 11:17:36 user nova-compute[74278]: INFO nova.virt.block_device [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Attempting to driver detach volume b61e991d-4265-4270-8037-59dbf3d9af2a from mountpoint /dev/vdb
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Attempting to detach device vdb from instance 00633014-ff03-4230-97fb-a81ce613c92d from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:17:36 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:17:36 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:17:36 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:17:36 user nova-compute[74278]:   <serial>b61e991d-4265-4270-8037-59dbf3d9af2a</serial>
Oct 30 11:17:36 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:17:36 user nova-compute[74278]: </disk>
Oct 30 11:17:36 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:17:36 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Successfully detached device vdb from instance 00633014-ff03-4230-97fb-a81ce613c92d from the persistent domain config.
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00633014-ff03-4230-97fb-a81ce613c92d from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:17:36 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:17:36 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:17:36 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:17:36 user nova-compute[74278]:   <serial>b61e991d-4265-4270-8037-59dbf3d9af2a</serial>
Oct 30 11:17:36 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:17:36 user nova-compute[74278]: </disk>
Oct 30 11:17:36 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "00633014-ff03-4230-97fb-a81ce613c92d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.compute.manager [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:17:36 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Creating image(s)
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Ensure instance console log exists: /opt/stack/data/nova/instances/0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Start _get_guest_xml network_info=[{"id": "6051f9bc-97da-4051-bb78-51e4f3227523", "address": "fa:16:3e:ba:40:47", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6051f9bc-97", "ovs_interfaceid": "6051f9bc-97da-4051-bb78-51e4f3227523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-30T11:16:50Z,direct_url=<?>,disk_format='qcow2',id=03369748-fb20-41f9-af46-bfd583bbc22f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-936173951',owner='59235488214e4149a91d6c2d5a02dd21',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-30T11:16:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpeKgDHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38', 'attached_at': '', 'detached_at': '', 'volume_id': '8fe058c5-516c-4899-bfd2-6f742e1ae892', 'serial': '8fe058c5-516c-4899-bfd2-6f742e1ae892'}, 'attachment_id': 'd4a1a487-5922-4a7f-bbda-8769cfb6dda5', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:17:36 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:17:36 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-30T11:16:50Z,direct_url=<?>,disk_format='qcow2',id=03369748-fb20-41f9-af46-bfd583bbc22f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-936173951',owner='59235488214e4149a91d6c2d5a02dd21',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-30T11:16:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpeKgDHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:17:36 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:17:36 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:17:36 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9868cc4-ba65-4dfa-93f2-cdac15b8d76d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:17:36 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[751bfe8d-902d-4621-b67e-242c4e2e6a42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892] added
Oct 30 11:17:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[620b624f-912f-4479-9d13-fc9fb3e628b8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a78a52-d393-4655-ae3c-abb7cee12a00]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kpeKgDHj {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kpeKgDHj" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d13daf8-0688-4357-8888-bfcf8e8f24ae]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kpeKgDHj'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32b0863-7c14-464c-9ad7-df96e5e25b73]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3118f10a-9d37-403b-83e7-13bc9dc2ae5f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:17:36 user nova-compute[74278]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a (non-flash)
Oct 30 11:17:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:17:36 user nova-compute[74278]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a (non-flash)
Oct 30 11:17:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9574ee-e499-4313-8bb5-4bc81ac7613a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892, portal: 172.16.0.220,3260]
Oct 30 11:17:36 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892, portal: 172.16.0.220,3260] successful.
Oct 30 11:17:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8595e636-da14-47fd-8ba9-7488d992fe52]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be781f3-8a59-4a4c-a855-7c5725c952f4]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:17:36 user nova-compute[74278]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a (non-flash)
Oct 30 11:17:36 user nova-compute[74278]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 (non-flash)
Oct 30 11:17:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:17:36 user nova-compute[74278]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a (non-flash)
Oct 30 11:17:36 user nova-compute[74278]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 (non-flash)
Oct 30 11:17:36 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[454f9df6-6344-4c6a-a828-25c7e669fd1a]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpeKgDHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:17:36 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00633014-ff03-4230-97fb-a81ce613c92d {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:17:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:17:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23431643431613231', 'path': '/dev/sdd'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:17:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431643431613231', 'path': '/dev/sdd'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:17:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-177231977',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-177231977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-177231977',id=43,image_ref='03369748-fb20-41f9-af46-bfd583bbc22f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsxgdWedzS2XuutORZwKgmo/maZb0JyIIAqCfX43KTml73k53d535LiqJOqNHt5QesaXvzB/rVMC84N/m6jvdx7ZeZLpnBo7c66BdCS8xa0pSENKU6uOzBWpaUbbwC+sg==',key_name='tempest-keypair-830477459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-nawrwoz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2008975673',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e921926b3790497fb9630088c501af82',uuid=0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6051f9bc-97da-4051-bb78-51e4f3227523", "address": "fa:16:3e:ba:40:47", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6051f9bc-97", "ovs_interfaceid": "6051f9bc-97da-4051-bb78-51e4f3227523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:17:37 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "6051f9bc-97da-4051-bb78-51e4f3227523", "address": "fa:16:3e:ba:40:47", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6051f9bc-97", "ovs_interfaceid": "6051f9bc-97da-4051-bb78-51e4f3227523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:17:37 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:40:47,bridge_name='br-int',has_traffic_filtering=True,id=6051f9bc-97da-4051-bb78-51e4f3227523,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6051f9bc-97') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG nova.objects.instance [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:17:38 user nova-compute[74278]:   <uuid>0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38</uuid>
Oct 30 11:17:38 user nova-compute[74278]:   <name>instance-0000002b</name>
Oct 30 11:17:38 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:17:38 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:17:38 user nova-compute[74278]:   <metadata>
Oct 30 11:17:38 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:17:38 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:17:38 user nova-compute[74278]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-177231977</nova:name>
Oct 30 11:17:38 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:17:36</nova:creationTime>
Oct 30 11:17:38 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:17:38 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:17:38 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:17:38 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:17:38 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:17:38 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:17:38 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:17:38 user nova-compute[74278]:       <nova:owner>
Oct 30 11:17:38 user nova-compute[74278]:         <nova:user uuid="e921926b3790497fb9630088c501af82">tempest-TestVolumeBootPattern-2008975673-project-member</nova:user>
Oct 30 11:17:38 user nova-compute[74278]:         <nova:project uuid="59235488214e4149a91d6c2d5a02dd21">tempest-TestVolumeBootPattern-2008975673</nova:project>
Oct 30 11:17:38 user nova-compute[74278]:       </nova:owner>
Oct 30 11:17:38 user nova-compute[74278]:       <nova:root type="image" uuid="03369748-fb20-41f9-af46-bfd583bbc22f"/>
Oct 30 11:17:38 user nova-compute[74278]:       <nova:ports>
Oct 30 11:17:38 user nova-compute[74278]:         <nova:port uuid="6051f9bc-97da-4051-bb78-51e4f3227523">
Oct 30 11:17:38 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 11:17:38 user nova-compute[74278]:         </nova:port>
Oct 30 11:17:38 user nova-compute[74278]:       </nova:ports>
Oct 30 11:17:38 user nova-compute[74278]:     </nova:instance>
Oct 30 11:17:38 user nova-compute[74278]:   </metadata>
Oct 30 11:17:38 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:17:38 user nova-compute[74278]:     <system>
Oct 30 11:17:38 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:17:38 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:17:38 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:17:38 user nova-compute[74278]:       <entry name="serial">0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38</entry>
Oct 30 11:17:38 user nova-compute[74278]:       <entry name="uuid">0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38</entry>
Oct 30 11:17:38 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:17:38 user nova-compute[74278]:     </system>
Oct 30 11:17:38 user nova-compute[74278]:   </sysinfo>
Oct 30 11:17:38 user nova-compute[74278]:   <os>
Oct 30 11:17:38 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:17:38 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:17:38 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:17:38 user nova-compute[74278]:   </os>
Oct 30 11:17:38 user nova-compute[74278]:   <features>
Oct 30 11:17:38 user nova-compute[74278]:     <acpi/>
Oct 30 11:17:38 user nova-compute[74278]:     <apic/>
Oct 30 11:17:38 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:17:38 user nova-compute[74278]:   </features>
Oct 30 11:17:38 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:17:38 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:17:38 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:17:38 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:17:38 user nova-compute[74278]:   </clock>
Oct 30 11:17:38 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:17:38 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:17:38 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:17:38 user nova-compute[74278]:   </cpu>
Oct 30 11:17:38 user nova-compute[74278]:   <devices>
Oct 30 11:17:38 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:17:38 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:17:38 user nova-compute[74278]:       <source dev="/dev/sdd"/>
Oct 30 11:17:38 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:17:38 user nova-compute[74278]:       <serial>8fe058c5-516c-4899-bfd2-6f742e1ae892</serial>
Oct 30 11:17:38 user nova-compute[74278]:     </disk>
Oct 30 11:17:38 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:17:38 user nova-compute[74278]:       <mac address="fa:16:3e:ba:40:47"/>
Oct 30 11:17:38 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:17:38 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:17:38 user nova-compute[74278]:       <target dev="tap6051f9bc-97"/>
Oct 30 11:17:38 user nova-compute[74278]:     </interface>
Oct 30 11:17:38 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:17:38 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38/console.log" append="off"/>
Oct 30 11:17:38 user nova-compute[74278]:     </serial>
Oct 30 11:17:38 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:17:38 user nova-compute[74278]:     <video>
Oct 30 11:17:38 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:17:38 user nova-compute[74278]:     </video>
Oct 30 11:17:38 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:17:38 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:17:38 user nova-compute[74278]:     </rng>
Oct 30 11:17:38 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:17:38 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:17:38 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:17:38 user nova-compute[74278]:     </memballoon>
Oct 30 11:17:38 user nova-compute[74278]:   </devices>
Oct 30 11:17:38 user nova-compute[74278]: </domain>
Oct 30 11:17:38 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-177231977',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-177231977',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-177231977',id=43,image_ref='03369748-fb20-41f9-af46-bfd583bbc22f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsxgdWedzS2XuutORZwKgmo/maZb0JyIIAqCfX43KTml73k53d535LiqJOqNHt5QesaXvzB/rVMC84N/m6jvdx7ZeZLpnBo7c66BdCS8xa0pSENKU6uOzBWpaUbbwC+sg==',key_name='tempest-keypair-830477459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-nawrwoz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2008975673',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e921926b3790497fb9630088c501af82',uuid=0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6051f9bc-97da-4051-bb78-51e4f3227523", "address": "fa:16:3e:ba:40:47", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6051f9bc-97", "ovs_interfaceid": "6051f9bc-97da-4051-bb78-51e4f3227523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "6051f9bc-97da-4051-bb78-51e4f3227523", "address": "fa:16:3e:ba:40:47", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6051f9bc-97", "ovs_interfaceid": "6051f9bc-97da-4051-bb78-51e4f3227523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:40:47,bridge_name='br-int',has_traffic_filtering=True,id=6051f9bc-97da-4051-bb78-51e4f3227523,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6051f9bc-97') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG os_vif [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:40:47,bridge_name='br-int',has_traffic_filtering=True,id=6051f9bc-97da-4051-bb78-51e4f3227523,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6051f9bc-97') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea29f603-6385-556e-8f87-9c2ba1311f4c', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6051f9bc-97, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6051f9bc-97, col_values=(('qos', UUID('f66202e1-ee57-46b1-bbcf-867ced779e68')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6051f9bc-97, col_values=(('external_ids', {'iface-id': '6051f9bc-97da-4051-bb78-51e4f3227523', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:40:47', 'vm-uuid': '0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:38 user nova-compute[74278]: INFO os_vif [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:40:47,bridge_name='br-int',has_traffic_filtering=True,id=6051f9bc-97da-4051-bb78-51e4f3227523,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6051f9bc-97')
Oct 30 11:17:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:17:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] No VIF found with MAC fa:16:3e:ba:40:47, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:17:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:39 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:17:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:39 user nova-compute[74278]: DEBUG nova.compute.manager [req-5478fd26-4e68-442f-adf6-fbbccb13aac8 req-f769a8a5-8bc4-4f44-853f-086f2523976b service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Received event network-vif-plugged-6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:17:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5478fd26-4e68-442f-adf6-fbbccb13aac8 req-f769a8a5-8bc4-4f44-853f-086f2523976b service nova] Acquiring lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5478fd26-4e68-442f-adf6-fbbccb13aac8 req-f769a8a5-8bc4-4f44-853f-086f2523976b service nova] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5478fd26-4e68-442f-adf6-fbbccb13aac8 req-f769a8a5-8bc4-4f44-853f-086f2523976b service nova] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:39 user nova-compute[74278]: DEBUG nova.compute.manager [req-5478fd26-4e68-442f-adf6-fbbccb13aac8 req-f769a8a5-8bc4-4f44-853f-086f2523976b service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] No waiting events found dispatching network-vif-plugged-6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:17:39 user nova-compute[74278]: WARNING nova.compute.manager [req-5478fd26-4e68-442f-adf6-fbbccb13aac8 req-f769a8a5-8bc4-4f44-853f-086f2523976b service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Received unexpected event network-vif-plugged-6051f9bc-97da-4051-bb78-51e4f3227523 for instance with vm_state building and task_state spawning.
Oct 30 11:17:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Skipping network cache update for instance because it is being deleted. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Skipping network cache update for instance because it is Building. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG nova.objects.instance [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lazy-loading 'info_cache' on Instance uuid 2b1e5787-b99f-4ace-9696-c1df8c0bee44 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Updating instance_info_cache with network_info: [{"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:17:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:17:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:17:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:17:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:17:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:17:41 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Instance spawned successfully.
Oct 30 11:17:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:17:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:17:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:17:41 user nova-compute[74278]: INFO nova.compute.manager [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Took 5.05 seconds to spawn the instance on the hypervisor.
Oct 30 11:17:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:17:41 user nova-compute[74278]: INFO nova.compute.manager [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Took 37.54 seconds to build instance.
Oct 30 11:17:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-2df644c4-4cea-4da9-8f9c-ead4430a7ebc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.646s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-a263dacc-865a-4196-bfae-8af2557737f3 req-25f326ad-353a-4fcf-b7a5-292bc4da3740 service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Received event network-vif-plugged-6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:17:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a263dacc-865a-4196-bfae-8af2557737f3 req-25f326ad-353a-4fcf-b7a5-292bc4da3740 service nova] Acquiring lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a263dacc-865a-4196-bfae-8af2557737f3 req-25f326ad-353a-4fcf-b7a5-292bc4da3740 service nova] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a263dacc-865a-4196-bfae-8af2557737f3 req-25f326ad-353a-4fcf-b7a5-292bc4da3740 service nova] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:41 user nova-compute[74278]: DEBUG nova.compute.manager [req-a263dacc-865a-4196-bfae-8af2557737f3 req-25f326ad-353a-4fcf-b7a5-292bc4da3740 service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] No waiting events found dispatching network-vif-plugged-6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:17:41 user nova-compute[74278]: WARNING nova.compute.manager [req-a263dacc-865a-4196-bfae-8af2557737f3 req-25f326ad-353a-4fcf-b7a5-292bc4da3740 service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Received unexpected event network-vif-plugged-6051f9bc-97da-4051-bb78-51e4f3227523 for instance with vm_state active and task_state None.
Oct 30 11:17:42 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:17:42 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:17:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:45 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:17:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:45 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:17:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:17:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:17:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:46 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:17:46 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:17:46 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8423MB free_disk=24.945919036865234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:17:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:17:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:17:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 00633014-ff03-4230-97fb-a81ce613c92d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:17:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2b1e5787-b99f-4ace-9696-c1df8c0bee44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:17:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:17:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:17:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:17:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:17:47 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:17:47 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:17:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:17:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:17:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:48 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:17:48 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:17:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:17:56 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 00633014-ff03-4230-97fb-a81ce613c92d is timed out.
Oct 30 11:17:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Successfully detached device vdb from instance 00633014-ff03-4230-97fb-a81ce613c92d from the live domain config.
Oct 30 11:17:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQCrUgLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:17:57 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e30f239-63c9-4465-b844-9183bad65f8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:17:57 user nova-compute[74278]: No targets found.
Oct 30 11:17:57 user nova-compute[74278]: iSNS:
Oct 30 11:17:57 user nova-compute[74278]: No targets found.
Oct 30 11:17:57 user nova-compute[74278]: STATIC:
Oct 30 11:17:57 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a
Oct 30 11:17:57 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:17:57 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:17:57 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f
Oct 30 11:17:57 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:17:57 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:17:57 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892
Oct 30 11:17:57 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:17:57 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:17:57 user nova-compute[74278]: FIRMWARE:
Oct 30 11:17:57 user nova-compute[74278]: No targets found.
Oct 30 11:17:57 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:17:57 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:17:57 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8caf3e-29ce-47fa-91ed-a970eb2a12c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c54371-9078-40ac-9125-473a310eba20]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:17:57 user nova-compute[74278]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a (non-flash)
Oct 30 11:17:57 user nova-compute[74278]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 (non-flash)
Oct 30 11:17:57 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:17:57 user nova-compute[74278]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a (non-flash)
Oct 30 11:17:57 user nova-compute[74278]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 (non-flash)
Oct 30 11:17:57 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c31e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5311d9-6dfc-4a4c-b490-0f26899d0c7f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[16da7f99-13fb-40ba-a445-c024a8b96428]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[271eb3ea-97f0-4e0f-b2c0-f45d9f40973c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[58105cef-6e0d-4184-8205-cc12f7ee4494]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f1c9c5-1d73-4c3b-b675-3ebe761bdda8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9173d951-9819-4be1-bab5-e9d683a24627]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a, portal: 172.16.0.220,3260]
Oct 30 11:17:57 user nova-compute[74278]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a, portal: 172.16.0.220,3260] successful.
Oct 30 11:17:57 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9450fafe-1c6b-470d-8b35-6cec30ab2553]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] <== disconnect_volume: return (327ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:17:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:17:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lazy-loading 'flavor' on Instance uuid 00633014-ff03-4230-97fb-a81ce613c92d {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a167bcc4-36fb-433f-b2b4-d7504e61e89b tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "00633014-ff03-4230-97fb-a81ce613c92d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.079s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "00633014-ff03-4230-97fb-a81ce613c92d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 29.944s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "00633014-ff03-4230-97fb-a81ce613c92d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "00633014-ff03-4230-97fb-a81ce613c92d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "00633014-ff03-4230-97fb-a81ce613c92d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:06 user nova-compute[74278]: INFO nova.compute.manager [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Terminating instance
Oct 30 11:18:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-f3103a34-0757-4675-ab1a-9b4b9c6be421 req-75425039-f2cc-4926-bc19-44198160f5fc service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Received event network-vif-unplugged-89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f3103a34-0757-4675-ab1a-9b4b9c6be421 req-75425039-f2cc-4926-bc19-44198160f5fc service nova] Acquiring lock "00633014-ff03-4230-97fb-a81ce613c92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f3103a34-0757-4675-ab1a-9b4b9c6be421 req-75425039-f2cc-4926-bc19-44198160f5fc service nova] Lock "00633014-ff03-4230-97fb-a81ce613c92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f3103a34-0757-4675-ab1a-9b4b9c6be421 req-75425039-f2cc-4926-bc19-44198160f5fc service nova] Lock "00633014-ff03-4230-97fb-a81ce613c92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-f3103a34-0757-4675-ab1a-9b4b9c6be421 req-75425039-f2cc-4926-bc19-44198160f5fc service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] No waiting events found dispatching network-vif-unplugged-89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:18:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-f3103a34-0757-4675-ab1a-9b4b9c6be421 req-75425039-f2cc-4926-bc19-44198160f5fc service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Received event network-vif-unplugged-89b53b4f-7677-4b8f-9253-14b9d6091ea2 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:18:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Instance destroyed successfully.
Oct 30 11:18:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lazy-loading 'resources' on Instance uuid 00633014-ff03-4230-97fb-a81ce613c92d {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1390899367',display_name='tempest-VolumesSnapshotTestJSON-instance-1390899367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1390899367',id=41,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzsvg61NNh95ESK/Gd9nrPK7HksBc4os15Fo24nxZmjO7DT0Hv9ydJsB8xEvK/BU8qlUOuE3X04hSonDHj79gcu2mAL9oIj1u9yV8AbB+17rkvTkNlTZ6cCPUEsJGslBg==',key_name='tempest-keypair-1399232390',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:14:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59ee9b3a0343474183d1e12dcef41703',ramdisk_id='',reservation_id='r-yggsd34x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-24712219',owner_user_name='tempest-VolumesSnapshotTestJSON-24712219-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffaf2383261d4cc1a6d7b304f515914b',uuid=00633014-ff03-4230-97fb-a81ce613c92d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "address": "fa:16:3e:be:97:6d", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b53b4f-76", "ovs_interfaceid": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Converting VIF {"id": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "address": "fa:16:3e:be:97:6d", "network": {"id": "90c8f7d2-ad41-4e31-aea1-4c17b81fca16", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1511876007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59ee9b3a0343474183d1e12dcef41703", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89b53b4f-76", "ovs_interfaceid": "89b53b4f-7677-4b8f-9253-14b9d6091ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:97:6d,bridge_name='br-int',has_traffic_filtering=True,id=89b53b4f-7677-4b8f-9253-14b9d6091ea2,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b53b4f-76') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_vif [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:97:6d,bridge_name='br-int',has_traffic_filtering=True,id=89b53b4f-7677-4b8f-9253-14b9d6091ea2,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b53b4f-76') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89b53b4f-76, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36d40f77-034a-4130-938f-4f0907218eff) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:07 user nova-compute[74278]: INFO os_vif [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:97:6d,bridge_name='br-int',has_traffic_filtering=True,id=89b53b4f-7677-4b8f-9253-14b9d6091ea2,network=Network(90c8f7d2-ad41-4e31-aea1-4c17b81fca16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89b53b4f-76')
Oct 30 11:18:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RQCrUgLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:18:07 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.011s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e416e925-5c2c-4c56-8441-eb2f59e35c0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:18:07 user nova-compute[74278]: No targets found.
Oct 30 11:18:07 user nova-compute[74278]: iSNS:
Oct 30 11:18:07 user nova-compute[74278]: No targets found.
Oct 30 11:18:07 user nova-compute[74278]: STATIC:
Oct 30 11:18:07 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f
Oct 30 11:18:07 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:18:07 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:18:07 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892
Oct 30 11:18:07 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:18:07 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:18:07 user nova-compute[74278]: FIRMWARE:
Oct 30 11:18:07 user nova-compute[74278]: No targets found.
Oct 30 11:18:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:18:07 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:18:07 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b61e991d-4265-4270-8037-59dbf3d9af2a', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[260fe83d-91a3-44ea-b2c5-e90b96ea6463]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bf595c-c3c4-46db-9918-cf94cd1caeb0]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:18:07 user nova-compute[74278]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 (non-flash)
Oct 30 11:18:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:18:07 user nova-compute[74278]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 (non-flash)
Oct 30 11:18:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac13df30>, {}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Disconnecting from: [] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] <== disconnect_volume: return (98ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:18:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Deleting instance files /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d_del
Oct 30 11:18:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Deletion of /opt/stack/data/nova/instances/00633014-ff03-4230-97fb-a81ce613c92d_del complete
Oct 30 11:18:07 user nova-compute[74278]: INFO nova.compute.manager [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 30 11:18:07 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:18:07 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:18:08 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:18:08 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Took 1.30 seconds to deallocate network for instance.
Oct 30 11:18:08 user nova-compute[74278]: WARNING nova.volume.cinder [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Attachment 8cdfb2f5-73b8-4ad8-8958-16ca0a6f8a11 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8cdfb2f5-73b8-4ad8-8958-16ca0a6f8a11. (HTTP 404) (Request-ID: req-65bd8d9f-b66e-4013-885b-5faee7b53d55)
Oct 30 11:18:08 user nova-compute[74278]: INFO nova.compute.manager [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Took 0.03 seconds to detach 1 volumes for instance.
Oct 30 11:18:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-cfaca6cc-b7bd-4d82-a117-2f0f25b78689 req-774ee99f-738e-431b-b49c-e9c5fc4afeb8 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Received event network-vif-plugged-89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-cfaca6cc-b7bd-4d82-a117-2f0f25b78689 req-774ee99f-738e-431b-b49c-e9c5fc4afeb8 service nova] Acquiring lock "00633014-ff03-4230-97fb-a81ce613c92d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-cfaca6cc-b7bd-4d82-a117-2f0f25b78689 req-774ee99f-738e-431b-b49c-e9c5fc4afeb8 service nova] Lock "00633014-ff03-4230-97fb-a81ce613c92d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-cfaca6cc-b7bd-4d82-a117-2f0f25b78689 req-774ee99f-738e-431b-b49c-e9c5fc4afeb8 service nova] Lock "00633014-ff03-4230-97fb-a81ce613c92d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-cfaca6cc-b7bd-4d82-a117-2f0f25b78689 req-774ee99f-738e-431b-b49c-e9c5fc4afeb8 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] No waiting events found dispatching network-vif-plugged-89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:18:08 user nova-compute[74278]: WARNING nova.compute.manager [req-cfaca6cc-b7bd-4d82-a117-2f0f25b78689 req-774ee99f-738e-431b-b49c-e9c5fc4afeb8 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Received unexpected event network-vif-plugged-89b53b4f-7677-4b8f-9253-14b9d6091ea2 for instance with vm_state active and task_state deleting.
Oct 30 11:18:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-cfaca6cc-b7bd-4d82-a117-2f0f25b78689 req-774ee99f-738e-431b-b49c-e9c5fc4afeb8 service nova] [instance: 00633014-ff03-4230-97fb-a81ce613c92d] Received event network-vif-deleted-89b53b4f-7677-4b8f-9253-14b9d6091ea2 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:09 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:18:09 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:18:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.531s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:09 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Deleted allocations for instance 00633014-ff03-4230-97fb-a81ce613c92d
Oct 30 11:18:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-af3e2d59-e72a-4f0a-8c61-2a30eed9c983 tempest-VolumesSnapshotTestJSON-24712219 tempest-VolumesSnapshotTestJSON-24712219-project-member] Lock "00633014-ff03-4230-97fb-a81ce613c92d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.259s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:18:15 user nova-compute[74278]: INFO nova.compute.claims [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Claim successful on node user
Oct 30 11:18:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG nova.network.neutron [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:18:15 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:18:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG nova.policy [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ad932a451724349a5c40964d7e75157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a881207e0d4a4314a979e3af56cf2f95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:18:15 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Creating image(s)
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "/opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "/opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "/opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.193s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:15 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "85e83e56-3a30-4c75-b480-b1d298352888" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "85e83e56-3a30-4c75-b480-b1d298352888" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.252s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk 1073741824" returned: 0 in 0.049s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.network.neutron [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Successfully created port: 5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:18:16 user nova-compute[74278]: INFO nova.compute.claims [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Claim successful on node user
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Cannot resize image /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Ensure instance console log exists: /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.372s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.network.neutron [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:18:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.compute.manager [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:18:16 user nova-compute[74278]: DEBUG nova.policy [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ad932a451724349a5c40964d7e75157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a881207e0d4a4314a979e3af56cf2f95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:18:17 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Creating image(s)
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "/opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "/opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "/opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Successfully updated port: 5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-d9d75f49-44d2-4f91-a074-7fc7bd98c097 req-f5bc9737-5e3d-4c94-aea3-7cba268cb33f service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-changed-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-d9d75f49-44d2-4f91-a074-7fc7bd98c097 req-f5bc9737-5e3d-4c94-aea3-7cba268cb33f service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Refreshing instance network info cache due to event network-changed-5e58a9e9-0fbe-41b9-9795-0de8d50150b3. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d9d75f49-44d2-4f91-a074-7fc7bd98c097 req-f5bc9737-5e3d-4c94-aea3-7cba268cb33f service nova] Acquiring lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d9d75f49-44d2-4f91-a074-7fc7bd98c097 req-f5bc9737-5e3d-4c94-aea3-7cba268cb33f service nova] Acquired lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.network.neutron [req-d9d75f49-44d2-4f91-a074-7fc7bd98c097 req-f5bc9737-5e3d-4c94-aea3-7cba268cb33f service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Refreshing network info cache for port 5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.network.neutron [req-d9d75f49-44d2-4f91-a074-7fc7bd98c097 req-f5bc9737-5e3d-4c94-aea3-7cba268cb33f service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.205s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Successfully created port: 360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk 1073741824" returned: 0 in 0.061s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.network.neutron [req-d9d75f49-44d2-4f91-a074-7fc7bd98c097 req-f5bc9737-5e3d-4c94-aea3-7cba268cb33f service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d9d75f49-44d2-4f91-a074-7fc7bd98c097 req-f5bc9737-5e3d-4c94-aea3-7cba268cb33f service nova] Releasing lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquired lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Cannot resize image /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Ensure instance console log exists: /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updating instance_info_cache with network_info: [{"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Releasing lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Instance network_info: |[{"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Start _get_guest_xml network_info=[{"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:18:18 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:18:18 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1317166121',display_name='tempest-ServerRescueNegativeTestJSON-server-1317166121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1317166121',id=45,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a881207e0d4a4314a979e3af56cf2f95',ramdisk_id='',reservation_id='r-si04jmc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2065673492',owner_user_name='tempest-ServerRescueNegativeTestJSON-2065673492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:18:16Z,user_data=None,user_id='8ad932a451724349a5c40964d7e75157',uuid=8cafd05d-e81c-4f9d-975d-f18bd37f8eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converting VIF {"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:a3:4a,bridge_name='br-int',has_traffic_filtering=True,id=5e58a9e9-0fbe-41b9-9795-0de8d50150b3,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e58a9e9-0f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.objects.instance [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Successfully updated port: 360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:18:18 user nova-compute[74278]:   <uuid>8cafd05d-e81c-4f9d-975d-f18bd37f8eb9</uuid>
Oct 30 11:18:18 user nova-compute[74278]:   <name>instance-0000002d</name>
Oct 30 11:18:18 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:18:18 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:18:18 user nova-compute[74278]:   <metadata>
Oct 30 11:18:18 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:18:18 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:18:18 user nova-compute[74278]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1317166121</nova:name>
Oct 30 11:18:18 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:18:18</nova:creationTime>
Oct 30 11:18:18 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:18:18 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:18:18 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:18:18 user nova-compute[74278]:       <nova:owner>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:user uuid="8ad932a451724349a5c40964d7e75157">tempest-ServerRescueNegativeTestJSON-2065673492-project-member</nova:user>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:project uuid="a881207e0d4a4314a979e3af56cf2f95">tempest-ServerRescueNegativeTestJSON-2065673492</nova:project>
Oct 30 11:18:18 user nova-compute[74278]:       </nova:owner>
Oct 30 11:18:18 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:18:18 user nova-compute[74278]:       <nova:ports>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:port uuid="5e58a9e9-0fbe-41b9-9795-0de8d50150b3">
Oct 30 11:18:18 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 11:18:18 user nova-compute[74278]:         </nova:port>
Oct 30 11:18:18 user nova-compute[74278]:       </nova:ports>
Oct 30 11:18:18 user nova-compute[74278]:     </nova:instance>
Oct 30 11:18:18 user nova-compute[74278]:   </metadata>
Oct 30 11:18:18 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:18:18 user nova-compute[74278]:     <system>
Oct 30 11:18:18 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:18:18 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:18:18 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:18:18 user nova-compute[74278]:       <entry name="serial">8cafd05d-e81c-4f9d-975d-f18bd37f8eb9</entry>
Oct 30 11:18:18 user nova-compute[74278]:       <entry name="uuid">8cafd05d-e81c-4f9d-975d-f18bd37f8eb9</entry>
Oct 30 11:18:18 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:18:18 user nova-compute[74278]:     </system>
Oct 30 11:18:18 user nova-compute[74278]:   </sysinfo>
Oct 30 11:18:18 user nova-compute[74278]:   <os>
Oct 30 11:18:18 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:18:18 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:18:18 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:18:18 user nova-compute[74278]:   </os>
Oct 30 11:18:18 user nova-compute[74278]:   <features>
Oct 30 11:18:18 user nova-compute[74278]:     <acpi/>
Oct 30 11:18:18 user nova-compute[74278]:     <apic/>
Oct 30 11:18:18 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:18:18 user nova-compute[74278]:   </features>
Oct 30 11:18:18 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:18:18 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:18:18 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:18:18 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:18:18 user nova-compute[74278]:   </clock>
Oct 30 11:18:18 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:18:18 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:18:18 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:18:18 user nova-compute[74278]:   </cpu>
Oct 30 11:18:18 user nova-compute[74278]:   <devices>
Oct 30 11:18:18 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:18:18 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:18:18 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk"/>
Oct 30 11:18:18 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:18:18 user nova-compute[74278]:     </disk>
Oct 30 11:18:18 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:18:18 user nova-compute[74278]:       <mac address="fa:16:3e:81:a3:4a"/>
Oct 30 11:18:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:18:18 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:18:18 user nova-compute[74278]:       <target dev="tap5e58a9e9-0f"/>
Oct 30 11:18:18 user nova-compute[74278]:     </interface>
Oct 30 11:18:18 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:18:18 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/console.log" append="off"/>
Oct 30 11:18:18 user nova-compute[74278]:     </serial>
Oct 30 11:18:18 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:18:18 user nova-compute[74278]:     <video>
Oct 30 11:18:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:18:18 user nova-compute[74278]:     </video>
Oct 30 11:18:18 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:18:18 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:18:18 user nova-compute[74278]:     </rng>
Oct 30 11:18:18 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:18:18 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:18:18 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:18:18 user nova-compute[74278]:     </memballoon>
Oct 30 11:18:18 user nova-compute[74278]:   </devices>
Oct 30 11:18:18 user nova-compute[74278]: </domain>
Oct 30 11:18:18 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1317166121',display_name='tempest-ServerRescueNegativeTestJSON-server-1317166121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1317166121',id=45,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a881207e0d4a4314a979e3af56cf2f95',ramdisk_id='',reservation_id='r-si04jmc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2065673492',owner_user_name='tempest-ServerRescueNegativeTestJSON-2065673492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:18:16Z,user_data=None,user_id='8ad932a451724349a5c40964d7e75157',uuid=8cafd05d-e81c-4f9d-975d-f18bd37f8eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converting VIF {"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:a3:4a,bridge_name='br-int',has_traffic_filtering=True,id=5e58a9e9-0fbe-41b9-9795-0de8d50150b3,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e58a9e9-0f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG os_vif [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a3:4a,bridge_name='br-int',has_traffic_filtering=True,id=5e58a9e9-0fbe-41b9-9795-0de8d50150b3,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e58a9e9-0f') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquired lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39448841-0a5b-5801-bc05-7294f917f9e1', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-5f872c21-6b38-4cc5-a9b3-23e10bec8535 req-480ac5fe-6353-43c1-b3ef-4b277dd30368 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received event network-changed-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-5f872c21-6b38-4cc5-a9b3-23e10bec8535 req-480ac5fe-6353-43c1-b3ef-4b277dd30368 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Refreshing instance network info cache due to event network-changed-360af3bb-6ad9-45f4-8f7f-5864a99a0e35. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5f872c21-6b38-4cc5-a9b3-23e10bec8535 req-480ac5fe-6353-43c1-b3ef-4b277dd30368 service nova] Acquiring lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e58a9e9-0f, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e58a9e9-0f, col_values=(('qos', UUID('488b157d-dd1c-473a-8ec5-adcea3979699')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e58a9e9-0f, col_values=(('external_ids', {'iface-id': '5e58a9e9-0fbe-41b9-9795-0de8d50150b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:a3:4a', 'vm-uuid': '8cafd05d-e81c-4f9d-975d-f18bd37f8eb9'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: INFO os_vif [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:a3:4a,bridge_name='br-int',has_traffic_filtering=True,id=5e58a9e9-0fbe-41b9-9795-0de8d50150b3,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e58a9e9-0f')
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No VIF found with MAC fa:16:3e:81:a3:4a, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updating instance_info_cache with network_info: [{"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Releasing lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Instance network_info: |[{"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5f872c21-6b38-4cc5-a9b3-23e10bec8535 req-480ac5fe-6353-43c1-b3ef-4b277dd30368 service nova] Acquired lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-5f872c21-6b38-4cc5-a9b3-23e10bec8535 req-480ac5fe-6353-43c1-b3ef-4b277dd30368 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Refreshing network info cache for port 360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Start _get_guest_xml network_info=[{"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:18:18 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:18:18 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1840118535',display_name='tempest-ServerRescueNegativeTestJSON-server-1840118535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1840118535',id=46,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a881207e0d4a4314a979e3af56cf2f95',ramdisk_id='',reservation_id='r-oypjijxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2065673492',owner_user_name='tempest-ServerRescueNegativeTestJSON-2065673492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:18:17Z,user_data=None,user_id='8ad932a451724349a5c40964d7e75157',uuid=85e83e56-3a30-4c75-b480-b1d298352888,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converting VIF {"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=360af3bb-6ad9-45f4-8f7f-5864a99a0e35,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360af3bb-6a') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.objects.instance [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'pci_devices' on Instance uuid 85e83e56-3a30-4c75-b480-b1d298352888 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:18:18 user nova-compute[74278]:   <uuid>85e83e56-3a30-4c75-b480-b1d298352888</uuid>
Oct 30 11:18:18 user nova-compute[74278]:   <name>instance-0000002e</name>
Oct 30 11:18:18 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:18:18 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:18:18 user nova-compute[74278]:   <metadata>
Oct 30 11:18:18 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:18:18 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:18:18 user nova-compute[74278]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1840118535</nova:name>
Oct 30 11:18:18 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:18:18</nova:creationTime>
Oct 30 11:18:18 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:18:18 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:18:18 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:18:18 user nova-compute[74278]:       <nova:owner>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:user uuid="8ad932a451724349a5c40964d7e75157">tempest-ServerRescueNegativeTestJSON-2065673492-project-member</nova:user>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:project uuid="a881207e0d4a4314a979e3af56cf2f95">tempest-ServerRescueNegativeTestJSON-2065673492</nova:project>
Oct 30 11:18:18 user nova-compute[74278]:       </nova:owner>
Oct 30 11:18:18 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:18:18 user nova-compute[74278]:       <nova:ports>
Oct 30 11:18:18 user nova-compute[74278]:         <nova:port uuid="360af3bb-6ad9-45f4-8f7f-5864a99a0e35">
Oct 30 11:18:18 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 11:18:18 user nova-compute[74278]:         </nova:port>
Oct 30 11:18:18 user nova-compute[74278]:       </nova:ports>
Oct 30 11:18:18 user nova-compute[74278]:     </nova:instance>
Oct 30 11:18:18 user nova-compute[74278]:   </metadata>
Oct 30 11:18:18 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:18:18 user nova-compute[74278]:     <system>
Oct 30 11:18:18 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:18:18 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:18:18 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:18:18 user nova-compute[74278]:       <entry name="serial">85e83e56-3a30-4c75-b480-b1d298352888</entry>
Oct 30 11:18:18 user nova-compute[74278]:       <entry name="uuid">85e83e56-3a30-4c75-b480-b1d298352888</entry>
Oct 30 11:18:18 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:18:18 user nova-compute[74278]:     </system>
Oct 30 11:18:18 user nova-compute[74278]:   </sysinfo>
Oct 30 11:18:18 user nova-compute[74278]:   <os>
Oct 30 11:18:18 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:18:18 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:18:18 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:18:18 user nova-compute[74278]:   </os>
Oct 30 11:18:18 user nova-compute[74278]:   <features>
Oct 30 11:18:18 user nova-compute[74278]:     <acpi/>
Oct 30 11:18:18 user nova-compute[74278]:     <apic/>
Oct 30 11:18:18 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:18:18 user nova-compute[74278]:   </features>
Oct 30 11:18:18 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:18:18 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:18:18 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:18:18 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:18:18 user nova-compute[74278]:   </clock>
Oct 30 11:18:18 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:18:18 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:18:18 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:18:18 user nova-compute[74278]:   </cpu>
Oct 30 11:18:18 user nova-compute[74278]:   <devices>
Oct 30 11:18:18 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:18:18 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:18:18 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk"/>
Oct 30 11:18:18 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:18:18 user nova-compute[74278]:     </disk>
Oct 30 11:18:18 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:18:18 user nova-compute[74278]:       <mac address="fa:16:3e:fc:b3:13"/>
Oct 30 11:18:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:18:18 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:18:18 user nova-compute[74278]:       <target dev="tap360af3bb-6a"/>
Oct 30 11:18:18 user nova-compute[74278]:     </interface>
Oct 30 11:18:18 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:18:18 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/console.log" append="off"/>
Oct 30 11:18:18 user nova-compute[74278]:     </serial>
Oct 30 11:18:18 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:18:18 user nova-compute[74278]:     <video>
Oct 30 11:18:18 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:18:18 user nova-compute[74278]:     </video>
Oct 30 11:18:18 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:18:18 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:18:18 user nova-compute[74278]:     </rng>
Oct 30 11:18:18 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:18:18 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:18:18 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:18:18 user nova-compute[74278]:     </memballoon>
Oct 30 11:18:18 user nova-compute[74278]:   </devices>
Oct 30 11:18:18 user nova-compute[74278]: </domain>
Oct 30 11:18:18 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1840118535',display_name='tempest-ServerRescueNegativeTestJSON-server-1840118535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1840118535',id=46,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a881207e0d4a4314a979e3af56cf2f95',ramdisk_id='',reservation_id='r-oypjijxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2065673492',owner_user_name='tempest-ServerRescueNegativeTestJSON-2065673492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:18:17Z,user_data=None,user_id='8ad932a451724349a5c40964d7e75157',uuid=85e83e56-3a30-4c75-b480-b1d298352888,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converting VIF {"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=360af3bb-6ad9-45f4-8f7f-5864a99a0e35,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360af3bb-6a') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG os_vif [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=360af3bb-6ad9-45f4-8f7f-5864a99a0e35,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360af3bb-6a') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1bbfdcc-b84b-547d-9303-fd679f2e86df', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap360af3bb-6a, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap360af3bb-6a, col_values=(('qos', UUID('bfa269ad-b570-4b74-9636-ea272c2a0284')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap360af3bb-6a, col_values=(('external_ids', {'iface-id': '360af3bb-6ad9-45f4-8f7f-5864a99a0e35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:b3:13', 'vm-uuid': '85e83e56-3a30-4c75-b480-b1d298352888'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:18 user nova-compute[74278]: INFO os_vif [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=360af3bb-6ad9-45f4-8f7f-5864a99a0e35,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360af3bb-6a')
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No VIF found with MAC fa:16:3e:fc:b3:13, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-5f872c21-6b38-4cc5-a9b3-23e10bec8535 req-480ac5fe-6353-43c1-b3ef-4b277dd30368 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updated VIF entry in instance network info cache for port 360af3bb-6ad9-45f4-8f7f-5864a99a0e35. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:18:18 user nova-compute[74278]: DEBUG nova.network.neutron [req-5f872c21-6b38-4cc5-a9b3-23e10bec8535 req-480ac5fe-6353-43c1-b3ef-4b277dd30368 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updating instance_info_cache with network_info: [{"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:18:19 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5f872c21-6b38-4cc5-a9b3-23e10bec8535 req-480ac5fe-6353-43c1-b3ef-4b277dd30368 service nova] Releasing lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:18:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-8679a10a-f693-44d7-86f7-1500404d2c76 req-dfb9af89-a3d9-402f-9738-721e3e144e8e service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8679a10a-f693-44d7-86f7-1500404d2c76 req-dfb9af89-a3d9-402f-9738-721e3e144e8e service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8679a10a-f693-44d7-86f7-1500404d2c76 req-dfb9af89-a3d9-402f-9738-721e3e144e8e service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8679a10a-f693-44d7-86f7-1500404d2c76 req-dfb9af89-a3d9-402f-9738-721e3e144e8e service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-8679a10a-f693-44d7-86f7-1500404d2c76 req-dfb9af89-a3d9-402f-9738-721e3e144e8e service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:18:20 user nova-compute[74278]: WARNING nova.compute.manager [req-8679a10a-f693-44d7-86f7-1500404d2c76 req-dfb9af89-a3d9-402f-9738-721e3e144e8e service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state building and task_state spawning.
Oct 30 11:18:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-1ee0debc-27e4-4728-93d1-78e7fcdb8654 req-11d9927f-ed37-4c44-968c-517fbdf8702e service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received event network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1ee0debc-27e4-4728-93d1-78e7fcdb8654 req-11d9927f-ed37-4c44-968c-517fbdf8702e service nova] Acquiring lock "85e83e56-3a30-4c75-b480-b1d298352888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1ee0debc-27e4-4728-93d1-78e7fcdb8654 req-11d9927f-ed37-4c44-968c-517fbdf8702e service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1ee0debc-27e4-4728-93d1-78e7fcdb8654 req-11d9927f-ed37-4c44-968c-517fbdf8702e service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:21 user nova-compute[74278]: DEBUG nova.compute.manager [req-1ee0debc-27e4-4728-93d1-78e7fcdb8654 req-11d9927f-ed37-4c44-968c-517fbdf8702e service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] No waiting events found dispatching network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:18:21 user nova-compute[74278]: WARNING nova.compute.manager [req-1ee0debc-27e4-4728-93d1-78e7fcdb8654 req-11d9927f-ed37-4c44-968c-517fbdf8702e service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received unexpected event network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 for instance with vm_state building and task_state spawning.
Oct 30 11:18:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-e24103c9-1920-4661-abcf-8d4079383804 req-1f424651-63e8-4bd3-ba05-6ad169e50edc service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e24103c9-1920-4661-abcf-8d4079383804 req-1f424651-63e8-4bd3-ba05-6ad169e50edc service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e24103c9-1920-4661-abcf-8d4079383804 req-1f424651-63e8-4bd3-ba05-6ad169e50edc service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e24103c9-1920-4661-abcf-8d4079383804 req-1f424651-63e8-4bd3-ba05-6ad169e50edc service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-e24103c9-1920-4661-abcf-8d4079383804 req-1f424651-63e8-4bd3-ba05-6ad169e50edc service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:18:22 user nova-compute[74278]: WARNING nova.compute.manager [req-e24103c9-1920-4661-abcf-8d4079383804 req-1f424651-63e8-4bd3-ba05-6ad169e50edc service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state building and task_state spawning.
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-3de29811-97bf-4bbf-9b8f-b898281a4793 req-1a132627-ffec-460f-963d-382a4ca66ae3 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received event network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3de29811-97bf-4bbf-9b8f-b898281a4793 req-1a132627-ffec-460f-963d-382a4ca66ae3 service nova] Acquiring lock "85e83e56-3a30-4c75-b480-b1d298352888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3de29811-97bf-4bbf-9b8f-b898281a4793 req-1a132627-ffec-460f-963d-382a4ca66ae3 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3de29811-97bf-4bbf-9b8f-b898281a4793 req-1a132627-ffec-460f-963d-382a4ca66ae3 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.compute.manager [req-3de29811-97bf-4bbf-9b8f-b898281a4793 req-1a132627-ffec-460f-963d-382a4ca66ae3 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] No waiting events found dispatching network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:18:23 user nova-compute[74278]: WARNING nova.compute.manager [req-3de29811-97bf-4bbf-9b8f-b898281a4793 req-1a132627-ffec-460f-963d-382a4ca66ae3 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received unexpected event network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 for instance with vm_state building and task_state spawning.
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:18:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Instance spawned successfully.
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:18:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Instance spawned successfully.
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:18:23 user nova-compute[74278]: INFO nova.compute.manager [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Took 6.36 seconds to spawn the instance on the hypervisor.
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:18:23 user nova-compute[74278]: INFO nova.compute.manager [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Took 7.71 seconds to spawn the instance on the hypervisor.
Oct 30 11:18:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:18:23 user nova-compute[74278]: INFO nova.compute.manager [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Took 7.25 seconds to build instance.
Oct 30 11:18:23 user nova-compute[74278]: INFO nova.compute.manager [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Took 8.37 seconds to build instance.
Oct 30 11:18:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-561a911d-5f22-4a0a-bcc5-c6bbcb516762 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "85e83e56-3a30-4c75-b480-b1d298352888" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.414s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-236e1aee-12fd-4864-821b-b6c0dee9e204 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.505s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:18:40 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:18:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:18:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:18:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:18:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:18:41 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:18:41 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updating instance_info_cache with network_info: [{"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:18:41 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:18:41 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:18:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:18:42 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:18:43 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:18:43 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:18:43 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:18:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:47 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:18:47 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:18:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8194MB free_disk=24.906917572021484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2b1e5787-b99f-4ace-9696-c1df8c0bee44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:18:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:49 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:18:49 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:18:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-2665aa07-59b2-4c1c-b259-89e8b0c94488 req-6bf6c396-a817-49cf-868d-ebbfccaae72a service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Received event network-changed-6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-2665aa07-59b2-4c1c-b259-89e8b0c94488 req-6bf6c396-a817-49cf-868d-ebbfccaae72a service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Refreshing instance network info cache due to event network-changed-6051f9bc-97da-4051-bb78-51e4f3227523. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:18:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2665aa07-59b2-4c1c-b259-89e8b0c94488 req-6bf6c396-a817-49cf-868d-ebbfccaae72a service nova] Acquiring lock "refresh_cache-0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:18:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2665aa07-59b2-4c1c-b259-89e8b0c94488 req-6bf6c396-a817-49cf-868d-ebbfccaae72a service nova] Acquired lock "refresh_cache-0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:18:54 user nova-compute[74278]: DEBUG nova.network.neutron [req-2665aa07-59b2-4c1c-b259-89e8b0c94488 req-6bf6c396-a817-49cf-868d-ebbfccaae72a service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Refreshing network info cache for port 6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:55 user nova-compute[74278]: INFO nova.compute.manager [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Terminating instance
Oct 30 11:18:55 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-2665aa07-59b2-4c1c-b259-89e8b0c94488 req-6bf6c396-a817-49cf-868d-ebbfccaae72a service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Updated VIF entry in instance network info cache for port 6051f9bc-97da-4051-bb78-51e4f3227523. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-2665aa07-59b2-4c1c-b259-89e8b0c94488 req-6bf6c396-a817-49cf-868d-ebbfccaae72a service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Updating instance_info_cache with network_info: [{"id": "6051f9bc-97da-4051-bb78-51e4f3227523", "address": "fa:16:3e:ba:40:47", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6051f9bc-97", "ovs_interfaceid": "6051f9bc-97da-4051-bb78-51e4f3227523", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2665aa07-59b2-4c1c-b259-89e8b0c94488 req-6bf6c396-a817-49cf-868d-ebbfccaae72a service nova] Releasing lock "refresh_cache-0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-8a0ebb67-c947-46af-8a9b-081e640bb387 req-b4c45cf7-62dd-4254-9b4e-fa466248eb1c service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Received event network-vif-unplugged-6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8a0ebb67-c947-46af-8a9b-081e640bb387 req-b4c45cf7-62dd-4254-9b4e-fa466248eb1c service nova] Acquiring lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8a0ebb67-c947-46af-8a9b-081e640bb387 req-b4c45cf7-62dd-4254-9b4e-fa466248eb1c service nova] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8a0ebb67-c947-46af-8a9b-081e640bb387 req-b4c45cf7-62dd-4254-9b4e-fa466248eb1c service nova] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-8a0ebb67-c947-46af-8a9b-081e640bb387 req-b4c45cf7-62dd-4254-9b4e-fa466248eb1c service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] No waiting events found dispatching network-vif-unplugged-6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-8a0ebb67-c947-46af-8a9b-081e640bb387 req-b4c45cf7-62dd-4254-9b4e-fa466248eb1c service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Received event network-vif-unplugged-6051f9bc-97da-4051-bb78-51e4f3227523 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:18:56 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Instance destroyed successfully.
Oct 30 11:18:56 user nova-compute[74278]: DEBUG nova.objects.instance [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lazy-loading 'resources' on Instance uuid 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-177231977',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-177231977',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-177231977',id=43,image_ref='03369748-fb20-41f9-af46-bfd583bbc22f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsxgdWedzS2XuutORZwKgmo/maZb0JyIIAqCfX43KTml73k53d535LiqJOqNHt5QesaXvzB/rVMC84N/m6jvdx7ZeZLpnBo7c66BdCS8xa0pSENKU6uOzBWpaUbbwC+sg==',key_name='tempest-keypair-830477459',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:17:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-nawrwoz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2008975673',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:17:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e921926b3790497fb9630088c501af82',uuid=0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6051f9bc-97da-4051-bb78-51e4f3227523", "address": "fa:16:3e:ba:40:47", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6051f9bc-97", "ovs_interfaceid": "6051f9bc-97da-4051-bb78-51e4f3227523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "6051f9bc-97da-4051-bb78-51e4f3227523", "address": "fa:16:3e:ba:40:47", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6051f9bc-97", "ovs_interfaceid": "6051f9bc-97da-4051-bb78-51e4f3227523", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:40:47,bridge_name='br-int',has_traffic_filtering=True,id=6051f9bc-97da-4051-bb78-51e4f3227523,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6051f9bc-97') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_vif [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:40:47,bridge_name='br-int',has_traffic_filtering=True,id=6051f9bc-97da-4051-bb78-51e4f3227523,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6051f9bc-97') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6051f9bc-97, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f66202e1-ee57-46b1-bbcf-867ced779e68) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:18:56 user nova-compute[74278]: INFO os_vif [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:40:47,bridge_name='br-int',has_traffic_filtering=True,id=6051f9bc-97da-4051-bb78-51e4f3227523,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6051f9bc-97')
Oct 30 11:18:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpeKgDHj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:18:56 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc28abf-b1ef-4c6c-b9b5-14bde81b263b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:18:56 user nova-compute[74278]: No targets found.
Oct 30 11:18:56 user nova-compute[74278]: iSNS:
Oct 30 11:18:56 user nova-compute[74278]: No targets found.
Oct 30 11:18:56 user nova-compute[74278]: STATIC:
Oct 30 11:18:56 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f
Oct 30 11:18:56 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:18:56 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:18:56 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892
Oct 30 11:18:56 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:18:56 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:18:56 user nova-compute[74278]: FIRMWARE:
Oct 30 11:18:56 user nova-compute[74278]: No targets found.
Oct 30 11:18:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:18:56 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:18:56 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[623bd5fa-0fef-4e8b-8638-002d8380bb34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[02aa9e5d-6562-4b94-88b0-15a770f28204]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:18:56 user nova-compute[74278]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 (non-flash)
Oct 30 11:18:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:18:56 user nova-compute[74278]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 (non-flash)
Oct 30 11:18:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c75ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892'): ({'sdd'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Removing single pathed devices sdd {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe28cbdc-fa68-4a8f-bf25-4b7a4608a52d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d68b6f-bb99-4883-a926-bf23f28f5b73]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flushing IO for device /dev/sdd {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bb188f-c634-48f5-a466-fc0336e97b6d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fb6112-af6e-4460-a17e-5e5631f14621]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOff9a012e-41d41a21d4fb12d2', '/dev/disk/by-id/scsi-23431643431613231', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ff9a012e') {{(pid=85487) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 11:18:56 user nova-compute[74278]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOff9a012e-41d41a21d4fb12d2
Oct 30 11:18:56 user nova-compute[74278]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23431643431613231
Oct 30 11:18:56 user nova-compute[74278]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ff9a012e
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3270bdd2-f19f-4778-9d63-50fcda6ad65c]: (4, None) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f3ae34-14b1-4c92-be22-fc5498d2fc3f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[becfe6b8-50cf-4f45-abc3-36a91b50ace1]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892, portal: 172.16.0.220,3260]
Oct 30 11:18:56 user nova-compute[74278]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892, portal: 172.16.0.220,3260] successful.
Oct 30 11:18:56 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fe058c5-516c-4899-bfd2-6f742e1ae892 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ed74b6-a34a-4a76-a6a2-7c24aa83296c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== disconnect_volume: return (323ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:18:56 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Deleting instance files /opt/stack/data/nova/instances/0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38_del
Oct 30 11:18:56 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Deletion of /opt/stack/data/nova/instances/0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38_del complete
Oct 30 11:18:56 user nova-compute[74278]: INFO nova.compute.manager [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 30 11:18:56 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:18:56 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:18:57 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:18:57 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Took 0.81 seconds to deallocate network for instance.
Oct 30 11:18:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-237cacfe-84cf-4f9a-a38c-1c050c487a27 req-63c6726a-11d6-4522-9553-dfa0738b1eb1 service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Received event network-vif-plugged-6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-237cacfe-84cf-4f9a-a38c-1c050c487a27 req-63c6726a-11d6-4522-9553-dfa0738b1eb1 service nova] Acquiring lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-237cacfe-84cf-4f9a-a38c-1c050c487a27 req-63c6726a-11d6-4522-9553-dfa0738b1eb1 service nova] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-237cacfe-84cf-4f9a-a38c-1c050c487a27 req-63c6726a-11d6-4522-9553-dfa0738b1eb1 service nova] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-237cacfe-84cf-4f9a-a38c-1c050c487a27 req-63c6726a-11d6-4522-9553-dfa0738b1eb1 service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] No waiting events found dispatching network-vif-plugged-6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:18:58 user nova-compute[74278]: WARNING nova.compute.manager [req-237cacfe-84cf-4f9a-a38c-1c050c487a27 req-63c6726a-11d6-4522-9553-dfa0738b1eb1 service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Received unexpected event network-vif-plugged-6051f9bc-97da-4051-bb78-51e4f3227523 for instance with vm_state active and task_state deleting.
Oct 30 11:18:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-237cacfe-84cf-4f9a-a38c-1c050c487a27 req-63c6726a-11d6-4522-9553-dfa0738b1eb1 service nova] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Received event network-vif-deleted-6051f9bc-97da-4051-bb78-51e4f3227523 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:18:58 user nova-compute[74278]: INFO nova.compute.manager [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Took 0.85 seconds to detach 1 volumes for instance.
Oct 30 11:18:58 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38] Deleting volume: 8fe058c5-516c-4899-bfd2-6f742e1ae892 {{(pid=74278) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 11:18:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:18:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:18:58 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:18:58 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:18:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:18:58 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Deleted allocations for instance 0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38
Oct 30 11:18:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ea564fe9-56c2-423d-88ca-8a91ade540b0 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "0dfb7d60-3e1b-46cb-8e6d-d33d0a51fa38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.446s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:19:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-3c1c3f61-fe64-4ec7-b64b-024e3034f595 req-16f78728-136f-416c-ba94-161d6eecc1af service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Received event network-changed-145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:19:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-3c1c3f61-fe64-4ec7-b64b-024e3034f595 req-16f78728-136f-416c-ba94-161d6eecc1af service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Refreshing instance network info cache due to event network-changed-145199b0-d3de-4607-949f-16e697b9b1db. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:19:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3c1c3f61-fe64-4ec7-b64b-024e3034f595 req-16f78728-136f-416c-ba94-161d6eecc1af service nova] Acquiring lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:19:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3c1c3f61-fe64-4ec7-b64b-024e3034f595 req-16f78728-136f-416c-ba94-161d6eecc1af service nova] Acquired lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:19:02 user nova-compute[74278]: DEBUG nova.network.neutron [req-3c1c3f61-fe64-4ec7-b64b-024e3034f595 req-16f78728-136f-416c-ba94-161d6eecc1af service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Refreshing network info cache for port 145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:19:03 user nova-compute[74278]: DEBUG nova.network.neutron [req-3c1c3f61-fe64-4ec7-b64b-024e3034f595 req-16f78728-136f-416c-ba94-161d6eecc1af service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updated VIF entry in instance network info cache for port 145199b0-d3de-4607-949f-16e697b9b1db. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:19:03 user nova-compute[74278]: DEBUG nova.network.neutron [req-3c1c3f61-fe64-4ec7-b64b-024e3034f595 req-16f78728-136f-416c-ba94-161d6eecc1af service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updating instance_info_cache with network_info: [{"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:19:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3c1c3f61-fe64-4ec7-b64b-024e3034f595 req-16f78728-136f-416c-ba94-161d6eecc1af service nova] Releasing lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:19:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:19:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:19:09 user nova-compute[74278]: DEBUG nova.objects.instance [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'flavor' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:19:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:19:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:19:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:19:09 user nova-compute[74278]: INFO nova.compute.manager [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attaching volume 9566998b-f309-4e14-ab43-076472602044 to /dev/vdb
Oct 30 11:19:10 user nova-compute[74278]: DEBUG os_brick.utils [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e27cc9-d363-4b33-b479-7fabeb89d1ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca71b7ec-583e-4c3c-b470-c2a102da2903]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[10624990-8225-4589-8175-af6eb0442f7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb03207-6a06-42f7-9fba-92f934b69b5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:19:10 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:19:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2693540e-f09b-4b93-9b64-7fcfba650f25]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG os_brick.utils [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updating existing volume attachment record: 1075622b-7960-44a4-8310-d91d549386ea {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:19:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:19:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQZMHfsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:19:29 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:19:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:19:29 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:19:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:19:29 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:19:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[702648a6-c161-44e0-aea7-57df6a039292]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:19:29 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50b07d8-369b-4380-bb27-d875b571a6fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044] added
Oct 30 11:19:29 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[238b1462-a640-4776-a971-f9043c6c6a54]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:19:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f27d81-d928-4179-90a2-08545868f16a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQZMHfsg {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQZMHfsg" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[98873a32-541c-49fa-bcc4-6fac01658c8b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FQZMHfsg'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81ebf17-20ef-4768-bd87-f4ab81bbd5da]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a031dee-6602-484d-9876-0ef3059d8bd2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:19:30 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:19:30 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d8201f-dba1-4210-8022-855e7c64f587]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044, portal: 172.16.0.220,3260]
Oct 30 11:19:30 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044, portal: 172.16.0.220,3260] successful.
Oct 30 11:19:30 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed61836d-aac5-4a7c-a966-53b56a7330c6]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e5fb1f-4e75-4ce4-b13a-f949ec209bd1]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:19:30 user nova-compute[74278]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 (non-flash)
Oct 30 11:19:30 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:19:30 user nova-compute[74278]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 (non-flash)
Oct 30 11:19:30 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bd7df8-b46f-498c-9b33-a4793813c119]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:30 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:19:31 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:19:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQZMHfsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:19:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:19:31 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26162323663336632', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:19:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162323663336632', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:19:31 user nova-compute[74278]: DEBUG nova.objects.instance [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'flavor' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:19:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:19:31 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:19:31 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:19:31 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:19:31 user nova-compute[74278]:   <serial>9566998b-f309-4e14-ab43-076472602044</serial>
Oct 30 11:19:31 user nova-compute[74278]: </disk>
Oct 30 11:19:31 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:19:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:19:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:19:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:19:31 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No VIF found with MAC fa:16:3e:91:ad:9d, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:19:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-354bdf41-ac21-4c34-b81b-09f51c257ed5 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.822s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:19:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:19:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:19:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG nova.objects.instance [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lazy-loading 'info_cache' on Instance uuid 2b1e5787-b99f-4ace-9696-c1df8c0bee44 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Updating instance_info_cache with network_info: [{"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-2b1e5787-b99f-4ace-9696-c1df8c0bee44" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:19:43 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:19:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:19:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:19:47 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:48 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:49 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:19:49 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:19:49 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8471MB free_disk=24.894805908203125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:19:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:19:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:19:49 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 2b1e5787-b99f-4ace-9696-c1df8c0bee44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:19:49 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:19:49 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:19:49 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:19:49 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:19:49 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:19:49 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:19:49 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:19:49 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:19:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:19:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:51 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:19:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:19:56 user nova-compute[74278]: INFO nova.compute.manager [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Terminating instance
Oct 30 11:19:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-0ffc5da8-cf08-454b-99b3-aba714a9b161 req-ce2e27bd-b677-4c76-b69e-8a7e05df1032 service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Received event network-vif-unplugged-a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0ffc5da8-cf08-454b-99b3-aba714a9b161 req-ce2e27bd-b677-4c76-b69e-8a7e05df1032 service nova] Acquiring lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0ffc5da8-cf08-454b-99b3-aba714a9b161 req-ce2e27bd-b677-4c76-b69e-8a7e05df1032 service nova] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0ffc5da8-cf08-454b-99b3-aba714a9b161 req-ce2e27bd-b677-4c76-b69e-8a7e05df1032 service nova] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-0ffc5da8-cf08-454b-99b3-aba714a9b161 req-ce2e27bd-b677-4c76-b69e-8a7e05df1032 service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] No waiting events found dispatching network-vif-unplugged-a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:19:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-0ffc5da8-cf08-454b-99b3-aba714a9b161 req-ce2e27bd-b677-4c76-b69e-8a7e05df1032 service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Received event network-vif-unplugged-a2610d53-faf6-4587-ae34-8c28e2f02425 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:19:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Instance destroyed successfully.
Oct 30 11:19:57 user nova-compute[74278]: DEBUG nova.objects.instance [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lazy-loading 'resources' on Instance uuid 2b1e5787-b99f-4ace-9696-c1df8c0bee44 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1419455301',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1419455301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1419455301',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5WFYhwLst3YoH7iDL8T8vEGMffHoPamnvJAKXkclxuQ5S3b3grejnXQImmwM2Co+fMkW21cfZxbZcmI2T6LatMyCr3jfuv84qKLCjksV10EGZngQYheWkMu2C5Qq2osA==',key_name='tempest-keypair-2005626570',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:15:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-b9bdywa4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:15:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e921926b3790497fb9630088c501af82',uuid=2b1e5787-b99f-4ace-9696-c1df8c0bee44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "a2610d53-faf6-4587-ae34-8c28e2f02425", "address": "fa:16:3e:79:72:42", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2610d53-fa", "ovs_interfaceid": "a2610d53-faf6-4587-ae34-8c28e2f02425", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:72:42,bridge_name='br-int',has_traffic_filtering=True,id=a2610d53-faf6-4587-ae34-8c28e2f02425,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2610d53-fa') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_vif [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:72:42,bridge_name='br-int',has_traffic_filtering=True,id=a2610d53-faf6-4587-ae34-8c28e2f02425,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2610d53-fa') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2610d53-fa, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8135cf9-0c5d-424f-8544-5fa8bafad96c) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:19:57 user nova-compute[74278]: INFO os_vif [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:72:42,bridge_name='br-int',has_traffic_filtering=True,id=a2610d53-faf6-4587-ae34-8c28e2f02425,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2610d53-fa')
Oct 30 11:19:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPwxHhJe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:19:57 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[95da1336-e034-428c-ac8e-98486ef06f0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:19:57 user nova-compute[74278]: No targets found.
Oct 30 11:19:57 user nova-compute[74278]: iSNS:
Oct 30 11:19:57 user nova-compute[74278]: No targets found.
Oct 30 11:19:57 user nova-compute[74278]: STATIC:
Oct 30 11:19:57 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f
Oct 30 11:19:57 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:19:57 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:19:57 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044
Oct 30 11:19:57 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:19:57 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:19:57 user nova-compute[74278]: FIRMWARE:
Oct 30 11:19:57 user nova-compute[74278]: No targets found.
Oct 30 11:19:57 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:19:57 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:19:57 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[96def58e-c290-4894-8cca-a8575b3d1490]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d786e3b1-d0d3-4c59-b589-4a385d10598d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:19:57 user nova-compute[74278]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 (non-flash)
Oct 30 11:19:57 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f (non-flash)
Oct 30 11:19:57 user nova-compute[74278]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 (non-flash)
Oct 30 11:19:57 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c75dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[07150b7f-7514-4cdc-8200-d69c658a0c40]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8186eb79-bc6d-4568-bcde-320d9b1e3df0]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a068bc9e-f684-4741-82bf-7ca5c24dfcf8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44fa41f-4092-4702-9519-db4c1fd1f6d8]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOdcecc114-796d7d619f0dba38', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_dcecc114', '/dev/disk/by-id/scsi-23739366437643631') {{(pid=85487) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfe3ba8-200d-49de-a1f9-ac4a88d25566]: (4, None) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b146933-47e1-43a1-bbb1-2f99cc078f9f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c607a72-545d-4e63-936e-32ab71a76fdd]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f, portal: 172.16.0.220,3260]
Oct 30 11:19:57 user nova-compute[74278]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f, portal: 172.16.0.220,3260] successful.
Oct 30 11:19:57 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:225a0e3b-f236-4849-b1e1-8e9e3b1efe8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8afa0e-5ebc-484b-adc1-ff4d366bdbfa]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== disconnect_volume: return (346ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:19:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Deleting instance files /opt/stack/data/nova/instances/2b1e5787-b99f-4ace-9696-c1df8c0bee44_del
Oct 30 11:19:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Deletion of /opt/stack/data/nova/instances/2b1e5787-b99f-4ace-9696-c1df8c0bee44_del complete
Oct 30 11:19:57 user nova-compute[74278]: INFO nova.compute.manager [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Took 1.34 seconds to destroy the instance on the hypervisor.
Oct 30 11:19:57 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:19:57 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:19:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-f8986a80-150a-4d25-a42f-109bd6ca0565 req-17cf6568-2329-4a97-98c3-f2541555ff6d service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Received event network-vif-plugged-a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:19:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f8986a80-150a-4d25-a42f-109bd6ca0565 req-17cf6568-2329-4a97-98c3-f2541555ff6d service nova] Acquiring lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:19:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f8986a80-150a-4d25-a42f-109bd6ca0565 req-17cf6568-2329-4a97-98c3-f2541555ff6d service nova] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:19:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f8986a80-150a-4d25-a42f-109bd6ca0565 req-17cf6568-2329-4a97-98c3-f2541555ff6d service nova] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:19:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-f8986a80-150a-4d25-a42f-109bd6ca0565 req-17cf6568-2329-4a97-98c3-f2541555ff6d service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] No waiting events found dispatching network-vif-plugged-a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:19:58 user nova-compute[74278]: WARNING nova.compute.manager [req-f8986a80-150a-4d25-a42f-109bd6ca0565 req-17cf6568-2329-4a97-98c3-f2541555ff6d service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Received unexpected event network-vif-plugged-a2610d53-faf6-4587-ae34-8c28e2f02425 for instance with vm_state active and task_state deleting.
Oct 30 11:19:59 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:19:59 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Took 1.43 seconds to deallocate network for instance.
Oct 30 11:19:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-274eb890-fa78-4e35-9918-ade322fa32a6 req-d86b1061-f2c5-4725-a046-1b36a64f8e4a service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Received event network-vif-deleted-a2610d53-faf6-4587-ae34-8c28e2f02425 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:19:59 user nova-compute[74278]: INFO nova.compute.manager [req-274eb890-fa78-4e35-9918-ade322fa32a6 req-d86b1061-f2c5-4725-a046-1b36a64f8e4a service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Neutron deleted interface a2610d53-faf6-4587-ae34-8c28e2f02425; detaching it from the instance and deleting it from the info cache
Oct 30 11:19:59 user nova-compute[74278]: DEBUG nova.network.neutron [req-274eb890-fa78-4e35-9918-ade322fa32a6 req-d86b1061-f2c5-4725-a046-1b36a64f8e4a service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:19:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-274eb890-fa78-4e35-9918-ade322fa32a6 req-d86b1061-f2c5-4725-a046-1b36a64f8e4a service nova] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Detach interface failed, port_id=a2610d53-faf6-4587-ae34-8c28e2f02425, reason: Instance 2b1e5787-b99f-4ace-9696-c1df8c0bee44 could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:20:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:00 user nova-compute[74278]: INFO nova.compute.manager [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Took 0.96 seconds to detach 1 volumes for instance.
Oct 30 11:20:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 2b1e5787-b99f-4ace-9696-c1df8c0bee44] Deleting volume: 225a0e3b-f236-4849-b1e1-8e9e3b1efe8f {{(pid=74278) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 11:20:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:00 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:20:00 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:20:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:00 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Deleted allocations for instance 2b1e5787-b99f-4ace-9696-c1df8c0bee44
Oct 30 11:20:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef3cdf73-be09-450d-b12c-3bce84ab3f98 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "2b1e5787-b99f-4ace-9696-c1df8c0bee44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.249s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:06 user nova-compute[74278]: INFO nova.compute.manager [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Rescuing
Oct 30 11:20:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:20:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquired lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:20:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:20:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updating instance_info_cache with network_info: [{"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:20:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Releasing lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:20:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-68d3bcda-920f-4960-b22a-1dfa63023a67 req-1173fb13-6caf-4e32-aeb1-854b4193d1d2 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received event network-vif-unplugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-68d3bcda-920f-4960-b22a-1dfa63023a67 req-1173fb13-6caf-4e32-aeb1-854b4193d1d2 service nova] Acquiring lock "85e83e56-3a30-4c75-b480-b1d298352888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-68d3bcda-920f-4960-b22a-1dfa63023a67 req-1173fb13-6caf-4e32-aeb1-854b4193d1d2 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-68d3bcda-920f-4960-b22a-1dfa63023a67 req-1173fb13-6caf-4e32-aeb1-854b4193d1d2 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-68d3bcda-920f-4960-b22a-1dfa63023a67 req-1173fb13-6caf-4e32-aeb1-854b4193d1d2 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] No waiting events found dispatching network-vif-unplugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:20:07 user nova-compute[74278]: WARNING nova.compute.manager [req-68d3bcda-920f-4960-b22a-1dfa63023a67 req-1173fb13-6caf-4e32-aeb1-854b4193d1d2 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received unexpected event network-vif-unplugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 for instance with vm_state active and task_state rescuing.
Oct 30 11:20:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Instance destroyed successfully.
Oct 30 11:20:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Attempting rescue
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74278) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Instance directory exists: not creating {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 11:20:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Creating image(s)
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "/opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "/opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "/opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'trusted_certs' on Instance uuid 85e83e56-3a30-4c75-b480-b1d298352888 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.209s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue" returned: 0 in 0.054s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'migration_context' on Instance uuid 85e83e56-3a30-4c75-b480-b1d298352888 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.objects.base [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<85e83e56-3a30-4c75-b480-b1d298352888> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Start _get_guest_xml network_info=[{"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "vif_mac": "fa:16:3e:fc:b3:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4107584d-f654-453b-972a-abcf1c7a0671', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'resources' on Instance uuid 85e83e56-3a30-4c75-b480-b1d298352888 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.objects.base [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<85e83e56-3a30-4c75-b480-b1d298352888> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'numa_topology' on Instance uuid 85e83e56-3a30-4c75-b480-b1d298352888 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.objects.base [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<85e83e56-3a30-4c75-b480-b1d298352888> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:20:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:20:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:20:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'vcpu_model' on Instance uuid 85e83e56-3a30-4c75-b480-b1d298352888 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.objects.base [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<85e83e56-3a30-4c75-b480-b1d298352888> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1840118535',display_name='tempest-ServerRescueNegativeTestJSON-server-1840118535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1840118535',id=46,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:18:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a881207e0d4a4314a979e3af56cf2f95',ramdisk_id='',reservation_id='r-oypjijxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2065673492',owner_user_name='tempest-ServerRescueNegativeTestJSON-2065673492-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:18:24Z,user_data=None,user_id='8ad932a451724349a5c40964d7e75157',uuid=85e83e56-3a30-4c75-b480-b1d298352888,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "vif_mac": "fa:16:3e:fc:b3:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converting VIF {"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "vif_mac": "fa:16:3e:fc:b3:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=360af3bb-6ad9-45f4-8f7f-5864a99a0e35,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360af3bb-6a') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.objects.instance [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'pci_devices' on Instance uuid 85e83e56-3a30-4c75-b480-b1d298352888 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.objects.base [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<85e83e56-3a30-4c75-b480-b1d298352888> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:20:08 user nova-compute[74278]:   <uuid>85e83e56-3a30-4c75-b480-b1d298352888</uuid>
Oct 30 11:20:08 user nova-compute[74278]:   <name>instance-0000002e</name>
Oct 30 11:20:08 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:20:08 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:20:08 user nova-compute[74278]:   <metadata>
Oct 30 11:20:08 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:20:08 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:20:08 user nova-compute[74278]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1840118535</nova:name>
Oct 30 11:20:08 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:20:07</nova:creationTime>
Oct 30 11:20:08 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:20:08 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:20:08 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:20:08 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:20:08 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:20:08 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:20:08 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:20:08 user nova-compute[74278]:       <nova:owner>
Oct 30 11:20:08 user nova-compute[74278]:         <nova:user uuid="8ad932a451724349a5c40964d7e75157">tempest-ServerRescueNegativeTestJSON-2065673492-project-member</nova:user>
Oct 30 11:20:08 user nova-compute[74278]:         <nova:project uuid="a881207e0d4a4314a979e3af56cf2f95">tempest-ServerRescueNegativeTestJSON-2065673492</nova:project>
Oct 30 11:20:08 user nova-compute[74278]:       </nova:owner>
Oct 30 11:20:08 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:20:08 user nova-compute[74278]:       <nova:ports>
Oct 30 11:20:08 user nova-compute[74278]:         <nova:port uuid="360af3bb-6ad9-45f4-8f7f-5864a99a0e35">
Oct 30 11:20:08 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 11:20:08 user nova-compute[74278]:         </nova:port>
Oct 30 11:20:08 user nova-compute[74278]:       </nova:ports>
Oct 30 11:20:08 user nova-compute[74278]:     </nova:instance>
Oct 30 11:20:08 user nova-compute[74278]:   </metadata>
Oct 30 11:20:08 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:20:08 user nova-compute[74278]:     <system>
Oct 30 11:20:08 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:20:08 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:20:08 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:20:08 user nova-compute[74278]:       <entry name="serial">85e83e56-3a30-4c75-b480-b1d298352888</entry>
Oct 30 11:20:08 user nova-compute[74278]:       <entry name="uuid">85e83e56-3a30-4c75-b480-b1d298352888</entry>
Oct 30 11:20:08 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:20:08 user nova-compute[74278]:     </system>
Oct 30 11:20:08 user nova-compute[74278]:   </sysinfo>
Oct 30 11:20:08 user nova-compute[74278]:   <os>
Oct 30 11:20:08 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:20:08 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:20:08 user nova-compute[74278]:   </os>
Oct 30 11:20:08 user nova-compute[74278]:   <features>
Oct 30 11:20:08 user nova-compute[74278]:     <acpi/>
Oct 30 11:20:08 user nova-compute[74278]:     <apic/>
Oct 30 11:20:08 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:20:08 user nova-compute[74278]:   </features>
Oct 30 11:20:08 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:20:08 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:20:08 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:20:08 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:20:08 user nova-compute[74278]:   </clock>
Oct 30 11:20:08 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:20:08 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:20:08 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:20:08 user nova-compute[74278]:   </cpu>
Oct 30 11:20:08 user nova-compute[74278]:   <devices>
Oct 30 11:20:08 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:20:08 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:20:08 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue"/>
Oct 30 11:20:08 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:20:08 user nova-compute[74278]:     </disk>
Oct 30 11:20:08 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:20:08 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:20:08 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk"/>
Oct 30 11:20:08 user nova-compute[74278]:       <target dev="vdb" bus="virtio"/>
Oct 30 11:20:08 user nova-compute[74278]:     </disk>
Oct 30 11:20:08 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:20:08 user nova-compute[74278]:       <mac address="fa:16:3e:fc:b3:13"/>
Oct 30 11:20:08 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:20:08 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:20:08 user nova-compute[74278]:       <target dev="tap360af3bb-6a"/>
Oct 30 11:20:08 user nova-compute[74278]:     </interface>
Oct 30 11:20:08 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:20:08 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/console.log" append="off"/>
Oct 30 11:20:08 user nova-compute[74278]:     </serial>
Oct 30 11:20:08 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:20:08 user nova-compute[74278]:     <video>
Oct 30 11:20:08 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:20:08 user nova-compute[74278]:     </video>
Oct 30 11:20:08 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:20:08 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:20:08 user nova-compute[74278]:     </rng>
Oct 30 11:20:08 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:20:08 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:20:08 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:20:08 user nova-compute[74278]:     </memballoon>
Oct 30 11:20:08 user nova-compute[74278]:   </devices>
Oct 30 11:20:08 user nova-compute[74278]: </domain>
Oct 30 11:20:08 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:20:08 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Instance destroyed successfully.
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No VIF found with MAC fa:16:3e:fc:b3:13, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:08 user nova-compute[74278]: INFO nova.compute.manager [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Detaching volume 9566998b-f309-4e14-ab43-076472602044
Oct 30 11:20:08 user nova-compute[74278]: INFO nova.virt.block_device [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attempting to driver detach volume 9566998b-f309-4e14-ab43-076472602044 from mountpoint /dev/vdb
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Attempting to detach device vdb from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:20:08 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:20:08 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:20:08 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:20:08 user nova-compute[74278]:   <serial>9566998b-f309-4e14-ab43-076472602044</serial>
Oct 30 11:20:08 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:20:08 user nova-compute[74278]: </disk>
Oct 30 11:20:08 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:20:08 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Successfully detached device vdb from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the persistent domain config.
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:20:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:20:08 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:20:08 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:20:08 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:20:08 user nova-compute[74278]:   <serial>9566998b-f309-4e14-ab43-076472602044</serial>
Oct 30 11:20:08 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:20:08 user nova-compute[74278]: </disk>
Oct 30 11:20:08 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:20:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-ee843f73-4699-4929-81ed-2ff302e96f44 req-66281291-a4ce-4b21-a5d9-0fb15c3ed293 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received event network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:20:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ee843f73-4699-4929-81ed-2ff302e96f44 req-66281291-a4ce-4b21-a5d9-0fb15c3ed293 service nova] Acquiring lock "85e83e56-3a30-4c75-b480-b1d298352888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ee843f73-4699-4929-81ed-2ff302e96f44 req-66281291-a4ce-4b21-a5d9-0fb15c3ed293 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ee843f73-4699-4929-81ed-2ff302e96f44 req-66281291-a4ce-4b21-a5d9-0fb15c3ed293 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-ee843f73-4699-4929-81ed-2ff302e96f44 req-66281291-a4ce-4b21-a5d9-0fb15c3ed293 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] No waiting events found dispatching network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:20:09 user nova-compute[74278]: WARNING nova.compute.manager [req-ee843f73-4699-4929-81ed-2ff302e96f44 req-66281291-a4ce-4b21-a5d9-0fb15c3ed293 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received unexpected event network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 for instance with vm_state active and task_state rescuing.
Oct 30 11:20:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:20:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:10 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:20:11 user nova-compute[74278]: INFO nova.compute.claims [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Claim successful on node user
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-8edb8f0b-96d5-4625-b0f8-929b2c55f1cd req-11b3e1b2-7deb-4c3e-a525-1566adc248b4 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received event network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8edb8f0b-96d5-4625-b0f8-929b2c55f1cd req-11b3e1b2-7deb-4c3e-a525-1566adc248b4 service nova] Acquiring lock "85e83e56-3a30-4c75-b480-b1d298352888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8edb8f0b-96d5-4625-b0f8-929b2c55f1cd req-11b3e1b2-7deb-4c3e-a525-1566adc248b4 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8edb8f0b-96d5-4625-b0f8-929b2c55f1cd req-11b3e1b2-7deb-4c3e-a525-1566adc248b4 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-8edb8f0b-96d5-4625-b0f8-929b2c55f1cd req-11b3e1b2-7deb-4c3e-a525-1566adc248b4 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] No waiting events found dispatching network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:20:11 user nova-compute[74278]: WARNING nova.compute.manager [req-8edb8f0b-96d5-4625-b0f8-929b2c55f1cd req-11b3e1b2-7deb-4c3e-a525-1566adc248b4 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received unexpected event network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 for instance with vm_state active and task_state rescuing.
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-8edb8f0b-96d5-4625-b0f8-929b2c55f1cd req-11b3e1b2-7deb-4c3e-a525-1566adc248b4 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received event network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8edb8f0b-96d5-4625-b0f8-929b2c55f1cd req-11b3e1b2-7deb-4c3e-a525-1566adc248b4 service nova] Acquiring lock "85e83e56-3a30-4c75-b480-b1d298352888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8edb8f0b-96d5-4625-b0f8-929b2c55f1cd req-11b3e1b2-7deb-4c3e-a525-1566adc248b4 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8edb8f0b-96d5-4625-b0f8-929b2c55f1cd req-11b3e1b2-7deb-4c3e-a525-1566adc248b4 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-8edb8f0b-96d5-4625-b0f8-929b2c55f1cd req-11b3e1b2-7deb-4c3e-a525-1566adc248b4 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] No waiting events found dispatching network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:20:11 user nova-compute[74278]: WARNING nova.compute.manager [req-8edb8f0b-96d5-4625-b0f8-929b2c55f1cd req-11b3e1b2-7deb-4c3e-a525-1566adc248b4 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received unexpected event network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 for instance with vm_state active and task_state rescuing.
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:20:11 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:20:11 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Creating image(s)
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "/opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "/opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "/opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "31a2c5ff6d6f5bafb89157e34091cb9d866ac116" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "31a2c5ff6d6f5bafb89157e34091cb9d866ac116" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:11 user nova-compute[74278]: DEBUG nova.policy [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03fb7307a64e4bcfb24ad4d337e12688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe8ef99a57b49049a3266b974ba661b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:20:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116.part --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116.part --force-share --output=json" returned: 0 in 0.215s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:12 user nova-compute[74278]: DEBUG nova.virt.images [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] 800f0d78-b4c0-4c66-b73f-cb80861926dd was qcow2, converting to raw {{(pid=74278) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 11:20:12 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 11:20:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116.part /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116.converted {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:12 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Successfully created port: 1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:20:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116.part /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116.converted" returned: 0 in 0.281s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116.converted --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-e84a4812-1c9c-49b3-b4d7-6bb65c998ccb tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "31a2c5ff6d6f5bafb89157e34091cb9d866ac116" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.195s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116 --force-share --output=json" returned: 0 in 0.221s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "31a2c5ff6d6f5bafb89157e34091cb9d866ac116" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "31a2c5ff6d6f5bafb89157e34091cb9d866ac116" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116 --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116,backing_fmt=raw /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116,backing_fmt=raw /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk 1073741824" returned: 0 in 0.052s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "31a2c5ff6d6f5bafb89157e34091cb9d866ac116" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116 --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Cannot resize image /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Ensure instance console log exists: /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Successfully updated port: 1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquired lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-32c41925-cd9c-4eb1-9590-fb3fc61a3270 req-edb8a1e0-8403-408b-ae8c-5982207cebaa service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-changed-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-32c41925-cd9c-4eb1-9590-fb3fc61a3270 req-edb8a1e0-8403-408b-ae8c-5982207cebaa service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Refreshing instance network info cache due to event network-changed-1ae17add-42be-43af-8b80-754d42bf694d. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-32c41925-cd9c-4eb1-9590-fb3fc61a3270 req-edb8a1e0-8403-408b-ae8c-5982207cebaa service nova] Acquiring lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.network.neutron [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updating instance_info_cache with network_info: [{"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Releasing lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Instance network_info: |[{"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-32c41925-cd9c-4eb1-9590-fb3fc61a3270 req-edb8a1e0-8403-408b-ae8c-5982207cebaa service nova] Acquired lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-32c41925-cd9c-4eb1-9590-fb3fc61a3270 req-edb8a1e0-8403-408b-ae8c-5982207cebaa service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Refreshing network info cache for port 1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Start _get_guest_xml network_info=[{"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T11:20:07Z,direct_url=<?>,disk_format='qcow2',id=800f0d78-b4c0-4c66-b73f-cb80861926dd,min_disk=0,min_ram=0,name='tempest-scenario-img--1065187446',owner='dbe8ef99a57b49049a3266b974ba661b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T11:20:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '800f0d78-b4c0-4c66-b73f-cb80861926dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:20:14 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:20:14 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T11:20:07Z,direct_url=<?>,disk_format='qcow2',id=800f0d78-b4c0-4c66-b73f-cb80861926dd,min_disk=0,min_ram=0,name='tempest-scenario-img--1065187446',owner='dbe8ef99a57b49049a3266b974ba661b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T11:20:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1731798367',display_name='tempest-TestMinimumBasicScenario-server-1731798367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1731798367',id=47,image_ref='800f0d78-b4c0-4c66-b73f-cb80861926dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxqPXVbuWiMlqYwfdErsmIIeIdNcrv3FqgQHQiihR1KMqooUkXPHLGwgb6OJJ4LmUjJypR/tWEYQurczPvIbbMlbzyUN/UyinQ7hkTZ6KZernIXGRzIY8KVINElc3sYmg==',key_name='tempest-TestMinimumBasicScenario-1479820048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbe8ef99a57b49049a3266b974ba661b',ramdisk_id='',reservation_id='r-jhg7w6qw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800f0d78-b4c0-4c66-b73f-cb80861926dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-274954723',owner_user_name='tempest-TestMinimumBasicScenario-274954723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:20:12Z,user_data=None,user_id='03fb7307a64e4bcfb24ad4d337e12688',uuid=194af77f-525c-4380-bead-6fbf5e1c7f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converting VIF {"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.objects.instance [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'pci_devices' on Instance uuid 194af77f-525c-4380-bead-6fbf5e1c7f1b {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:20:14 user nova-compute[74278]:   <uuid>194af77f-525c-4380-bead-6fbf5e1c7f1b</uuid>
Oct 30 11:20:14 user nova-compute[74278]:   <name>instance-0000002f</name>
Oct 30 11:20:14 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:20:14 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:20:14 user nova-compute[74278]:   <metadata>
Oct 30 11:20:14 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:20:14 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:20:14 user nova-compute[74278]:       <nova:name>tempest-TestMinimumBasicScenario-server-1731798367</nova:name>
Oct 30 11:20:14 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:20:14</nova:creationTime>
Oct 30 11:20:14 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:20:14 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:20:14 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:20:14 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:20:14 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:20:14 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:20:14 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:20:14 user nova-compute[74278]:       <nova:owner>
Oct 30 11:20:14 user nova-compute[74278]:         <nova:user uuid="03fb7307a64e4bcfb24ad4d337e12688">tempest-TestMinimumBasicScenario-274954723-project-member</nova:user>
Oct 30 11:20:14 user nova-compute[74278]:         <nova:project uuid="dbe8ef99a57b49049a3266b974ba661b">tempest-TestMinimumBasicScenario-274954723</nova:project>
Oct 30 11:20:14 user nova-compute[74278]:       </nova:owner>
Oct 30 11:20:14 user nova-compute[74278]:       <nova:root type="image" uuid="800f0d78-b4c0-4c66-b73f-cb80861926dd"/>
Oct 30 11:20:14 user nova-compute[74278]:       <nova:ports>
Oct 30 11:20:14 user nova-compute[74278]:         <nova:port uuid="1ae17add-42be-43af-8b80-754d42bf694d">
Oct 30 11:20:14 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 11:20:14 user nova-compute[74278]:         </nova:port>
Oct 30 11:20:14 user nova-compute[74278]:       </nova:ports>
Oct 30 11:20:14 user nova-compute[74278]:     </nova:instance>
Oct 30 11:20:14 user nova-compute[74278]:   </metadata>
Oct 30 11:20:14 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:20:14 user nova-compute[74278]:     <system>
Oct 30 11:20:14 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:20:14 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:20:14 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:20:14 user nova-compute[74278]:       <entry name="serial">194af77f-525c-4380-bead-6fbf5e1c7f1b</entry>
Oct 30 11:20:14 user nova-compute[74278]:       <entry name="uuid">194af77f-525c-4380-bead-6fbf5e1c7f1b</entry>
Oct 30 11:20:14 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:20:14 user nova-compute[74278]:     </system>
Oct 30 11:20:14 user nova-compute[74278]:   </sysinfo>
Oct 30 11:20:14 user nova-compute[74278]:   <os>
Oct 30 11:20:14 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:20:14 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:20:14 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:20:14 user nova-compute[74278]:   </os>
Oct 30 11:20:14 user nova-compute[74278]:   <features>
Oct 30 11:20:14 user nova-compute[74278]:     <acpi/>
Oct 30 11:20:14 user nova-compute[74278]:     <apic/>
Oct 30 11:20:14 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:20:14 user nova-compute[74278]:   </features>
Oct 30 11:20:14 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:20:14 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:20:14 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:20:14 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:20:14 user nova-compute[74278]:   </clock>
Oct 30 11:20:14 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:20:14 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:20:14 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:20:14 user nova-compute[74278]:   </cpu>
Oct 30 11:20:14 user nova-compute[74278]:   <devices>
Oct 30 11:20:14 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:20:14 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:20:14 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk"/>
Oct 30 11:20:14 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:20:14 user nova-compute[74278]:     </disk>
Oct 30 11:20:14 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:20:14 user nova-compute[74278]:       <mac address="fa:16:3e:fb:dc:24"/>
Oct 30 11:20:14 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:20:14 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:20:14 user nova-compute[74278]:       <target dev="tap1ae17add-42"/>
Oct 30 11:20:14 user nova-compute[74278]:     </interface>
Oct 30 11:20:14 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:20:14 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/console.log" append="off"/>
Oct 30 11:20:14 user nova-compute[74278]:     </serial>
Oct 30 11:20:14 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:20:14 user nova-compute[74278]:     <video>
Oct 30 11:20:14 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:20:14 user nova-compute[74278]:     </video>
Oct 30 11:20:14 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:20:14 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:20:14 user nova-compute[74278]:     </rng>
Oct 30 11:20:14 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:20:14 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:20:14 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:20:14 user nova-compute[74278]:     </memballoon>
Oct 30 11:20:14 user nova-compute[74278]:   </devices>
Oct 30 11:20:14 user nova-compute[74278]: </domain>
Oct 30 11:20:14 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1731798367',display_name='tempest-TestMinimumBasicScenario-server-1731798367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1731798367',id=47,image_ref='800f0d78-b4c0-4c66-b73f-cb80861926dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxqPXVbuWiMlqYwfdErsmIIeIdNcrv3FqgQHQiihR1KMqooUkXPHLGwgb6OJJ4LmUjJypR/tWEYQurczPvIbbMlbzyUN/UyinQ7hkTZ6KZernIXGRzIY8KVINElc3sYmg==',key_name='tempest-TestMinimumBasicScenario-1479820048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbe8ef99a57b49049a3266b974ba661b',ramdisk_id='',reservation_id='r-jhg7w6qw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800f0d78-b4c0-4c66-b73f-cb80861926dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-274954723',owner_user_name='tempest-TestMinimumBasicScenario-274954723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:20:12Z,user_data=None,user_id='03fb7307a64e4bcfb24ad4d337e12688',uuid=194af77f-525c-4380-bead-6fbf5e1c7f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converting VIF {"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG os_vif [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40a759e7-5e4c-55f9-960c-ee6e791f4adf', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ae17add-42, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ae17add-42, col_values=(('qos', UUID('e8c0cb75-ff07-4265-8821-9680b1ee0a96')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ae17add-42, col_values=(('external_ids', {'iface-id': '1ae17add-42be-43af-8b80-754d42bf694d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:dc:24', 'vm-uuid': '194af77f-525c-4380-bead-6fbf5e1c7f1b'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:14 user nova-compute[74278]: INFO os_vif [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42')
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:20:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] No VIF found with MAC fa:16:3e:fb:dc:24, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:20:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-32c41925-cd9c-4eb1-9590-fb3fc61a3270 req-edb8a1e0-8403-408b-ae8c-5982207cebaa service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updated VIF entry in instance network info cache for port 1ae17add-42be-43af-8b80-754d42bf694d. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:20:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-32c41925-cd9c-4eb1-9590-fb3fc61a3270 req-edb8a1e0-8403-408b-ae8c-5982207cebaa service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updating instance_info_cache with network_info: [{"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:20:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-32c41925-cd9c-4eb1-9590-fb3fc61a3270 req-edb8a1e0-8403-408b-ae8c-5982207cebaa service nova] Releasing lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:20:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:16 user nova-compute[74278]: DEBUG nova.compute.manager [req-616ca92c-f2fa-467a-a90b-b825f9baebb9 req-263be632-834b-44c1-89fd-2e7ffc242a7e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:20:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-616ca92c-f2fa-467a-a90b-b825f9baebb9 req-263be632-834b-44c1-89fd-2e7ffc242a7e service nova] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-616ca92c-f2fa-467a-a90b-b825f9baebb9 req-263be632-834b-44c1-89fd-2e7ffc242a7e service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:16 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-616ca92c-f2fa-467a-a90b-b825f9baebb9 req-263be632-834b-44c1-89fd-2e7ffc242a7e service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:16 user nova-compute[74278]: DEBUG nova.compute.manager [req-616ca92c-f2fa-467a-a90b-b825f9baebb9 req-263be632-834b-44c1-89fd-2e7ffc242a7e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] No waiting events found dispatching network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:20:16 user nova-compute[74278]: WARNING nova.compute.manager [req-616ca92c-f2fa-467a-a90b-b825f9baebb9 req-263be632-834b-44c1-89fd-2e7ffc242a7e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received unexpected event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d for instance with vm_state building and task_state spawning.
Oct 30 11:20:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-eb4cce95-39ff-4afd-8047-a53b4c82bffc req-202f38c0-9126-4434-aaaa-ea1f8e8cf20c service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:20:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eb4cce95-39ff-4afd-8047-a53b4c82bffc req-202f38c0-9126-4434-aaaa-ea1f8e8cf20c service nova] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eb4cce95-39ff-4afd-8047-a53b4c82bffc req-202f38c0-9126-4434-aaaa-ea1f8e8cf20c service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eb4cce95-39ff-4afd-8047-a53b4c82bffc req-202f38c0-9126-4434-aaaa-ea1f8e8cf20c service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:18 user nova-compute[74278]: DEBUG nova.compute.manager [req-eb4cce95-39ff-4afd-8047-a53b4c82bffc req-202f38c0-9126-4434-aaaa-ea1f8e8cf20c service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] No waiting events found dispatching network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:20:18 user nova-compute[74278]: WARNING nova.compute.manager [req-eb4cce95-39ff-4afd-8047-a53b4c82bffc req-202f38c0-9126-4434-aaaa-ea1f8e8cf20c service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received unexpected event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d for instance with vm_state building and task_state spawning.
Oct 30 11:20:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:20:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:20:18 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Instance spawned successfully.
Oct 30 11:20:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:20:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:20:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:20:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:20:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:20:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:20:18 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:20:18 user nova-compute[74278]: INFO nova.compute.manager [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Took 6.97 seconds to spawn the instance on the hypervisor.
Oct 30 11:20:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:20:18 user nova-compute[74278]: INFO nova.compute.manager [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Took 7.87 seconds to build instance.
Oct 30 11:20:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-d3502184-e241-4081-bb1b-7ff9e9387cdc tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.107s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:29 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 is timed out.
Oct 30 11:20:29 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Successfully detached device vdb from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the live domain config.
Oct 30 11:20:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQZMHfsg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:20:29 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24f2c22-d98f-43df-9a20-9d4c720aca30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:20:29 user nova-compute[74278]: No targets found.
Oct 30 11:20:29 user nova-compute[74278]: iSNS:
Oct 30 11:20:29 user nova-compute[74278]: No targets found.
Oct 30 11:20:29 user nova-compute[74278]: STATIC:
Oct 30 11:20:29 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044
Oct 30 11:20:29 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:20:29 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:20:29 user nova-compute[74278]: FIRMWARE:
Oct 30 11:20:29 user nova-compute[74278]: No targets found.
Oct 30 11:20:29 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:20:29 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:20:29 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3f3d90-428d-47f7-888e-ad21287be6f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efee243-71bc-4f5f-aeb9-ee0a1185bb23]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 (non-flash)
Oct 30 11:20:29 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 (non-flash)
Oct 30 11:20:29 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c598310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2ef06a-14e6-4899-a82e-a98c6e80b6f2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3172cd45-4bed-4d9d-9922-b39dd74f50d9]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[553c82ff-e7f1-4407-b259-b86e966ed5d8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1481b71d-cd58-4201-955d-780e6a2433b4]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c25360c-9d76-4c45-8d26-057b05bebf62]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25ad43a-a2ad-4953-923e-5a2d898dcc53]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044, portal: 172.16.0.220,3260]
Oct 30 11:20:29 user nova-compute[74278]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044, portal: 172.16.0.220,3260] successful.
Oct 30 11:20:29 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9566998b-f309-4e14-ab43-076472602044 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b187d541-347c-4fcd-aca8-b969d817fe40]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] <== disconnect_volume: return (287ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:20:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:30 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'flavor' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:20:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a1e0c0ad-72bd-40fd-b098-29c665dfd2fd tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.913s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:20:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:20:43 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:20:43 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:20:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:20:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:20:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:20:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:20:44 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:20:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:45 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updating instance_info_cache with network_info: [{"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:20:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:20:45 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:20:45 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:20:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:20:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:20:52 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:20:52 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:20:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8408MB free_disk=24.800811767578125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:20:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:20:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:20:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:20:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:20:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:20:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 194af77f-525c-4380-bead-6fbf5e1c7f1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:20:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:20:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:20:52 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:20:52 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:20:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:20:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:20:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:20:58 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:20:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'flavor' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:21:05 user nova-compute[74278]: INFO nova.compute.manager [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attaching volume f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 to /dev/vdb
Oct 30 11:21:05 user nova-compute[74278]: DEBUG os_brick.utils [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0948756c-1701-4428-ad6e-20b30ee93b78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[68010f60-14f9-44aa-8739-f2261287fdb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6381612f-6ab3-4655-97b9-466d6c223c72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc8970c-634e-4521-870a-1040b26cecf2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:21:05 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:21:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42cecda-bd14-4be5-825b-0aa8b1132dc2]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG os_brick.utils [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:21:05 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updating existing volume attachment record: 1b09dfac-7084-48e7-9b36-3faf0c73db46 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:21:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "9554853a-f1b2-4987-98ae-1e0465831d83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:21:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "9554853a-f1b2-4987-98ae-1e0465831d83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:21:07 user nova-compute[74278]: DEBUG nova.compute.manager [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:21:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:21:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:21:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:21:07 user nova-compute[74278]: INFO nova.compute.claims [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Claim successful on node user
Oct 30 11:21:07 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:21:07 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:21:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:21:07 user nova-compute[74278]: DEBUG nova.compute.manager [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG nova.network.neutron [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:21:08 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:21:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG nova.policy [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e921926b3790497fb9630088c501af82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59235488214e4149a91d6c2d5a02dd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:21:08 user nova-compute[74278]: INFO nova.virt.block_device [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Booting with volume 3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 at /dev/vda
Oct 30 11:21:08 user nova-compute[74278]: DEBUG os_brick.utils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf4a601-b247-4e31-b067-99d3c2d16f7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5af8c7-2fac-431c-854c-9a653f4c1ce2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4866993-bdf7-4692-b7d2-ac9b39ade001]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eca9a00-d6fe-4782-bbeb-192ca5522a46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:21:08 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:21:08 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d501eb-9de2-43c7-ac42-22dfe819a869]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG os_brick.utils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Updating existing volume attachment record: a4ba8ed2-c217-4f1a-a592-5133316e300e {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:21:08 user nova-compute[74278]: DEBUG nova.network.neutron [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Successfully created port: 85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:21:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:09 user nova-compute[74278]: DEBUG nova.network.neutron [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Successfully updated port: 85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:21:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "refresh_cache-9554853a-f1b2-4987-98ae-1e0465831d83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:21:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquired lock "refresh_cache-9554853a-f1b2-4987-98ae-1e0465831d83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:21:09 user nova-compute[74278]: DEBUG nova.network.neutron [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:21:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-377b5469-5861-4c60-ac04-46a61fe41eb5 req-f9a1d8b2-5901-471c-8d18-ba77131a6024 service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Received event network-changed-85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:21:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-377b5469-5861-4c60-ac04-46a61fe41eb5 req-f9a1d8b2-5901-471c-8d18-ba77131a6024 service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Refreshing instance network info cache due to event network-changed-85ada461-0fb8-477d-b82e-ad0ed048c150. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:21:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-377b5469-5861-4c60-ac04-46a61fe41eb5 req-f9a1d8b2-5901-471c-8d18-ba77131a6024 service nova] Acquiring lock "refresh_cache-9554853a-f1b2-4987-98ae-1e0465831d83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:21:10 user nova-compute[74278]: DEBUG nova.network.neutron [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:21:10 user nova-compute[74278]: DEBUG nova.network.neutron [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Updating instance_info_cache with network_info: [{"id": "85ada461-0fb8-477d-b82e-ad0ed048c150", "address": "fa:16:3e:09:12:f2", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ada461-0f", "ovs_interfaceid": "85ada461-0fb8-477d-b82e-ad0ed048c150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:21:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Releasing lock "refresh_cache-9554853a-f1b2-4987-98ae-1e0465831d83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:21:10 user nova-compute[74278]: DEBUG nova.compute.manager [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Instance network_info: |[{"id": "85ada461-0fb8-477d-b82e-ad0ed048c150", "address": "fa:16:3e:09:12:f2", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ada461-0f", "ovs_interfaceid": "85ada461-0fb8-477d-b82e-ad0ed048c150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:21:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-377b5469-5861-4c60-ac04-46a61fe41eb5 req-f9a1d8b2-5901-471c-8d18-ba77131a6024 service nova] Acquired lock "refresh_cache-9554853a-f1b2-4987-98ae-1e0465831d83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:21:10 user nova-compute[74278]: DEBUG nova.network.neutron [req-377b5469-5861-4c60-ac04-46a61fe41eb5 req-f9a1d8b2-5901-471c-8d18-ba77131a6024 service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Refreshing network info cache for port 85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:21:10 user nova-compute[74278]: DEBUG nova.network.neutron [req-377b5469-5861-4c60-ac04-46a61fe41eb5 req-f9a1d8b2-5901-471c-8d18-ba77131a6024 service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Updated VIF entry in instance network info cache for port 85ada461-0fb8-477d-b82e-ad0ed048c150. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:21:10 user nova-compute[74278]: DEBUG nova.network.neutron [req-377b5469-5861-4c60-ac04-46a61fe41eb5 req-f9a1d8b2-5901-471c-8d18-ba77131a6024 service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Updating instance_info_cache with network_info: [{"id": "85ada461-0fb8-477d-b82e-ad0ed048c150", "address": "fa:16:3e:09:12:f2", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ada461-0f", "ovs_interfaceid": "85ada461-0fb8-477d-b82e-ad0ed048c150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:21:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-377b5469-5861-4c60-ac04-46a61fe41eb5 req-f9a1d8b2-5901-471c-8d18-ba77131a6024 service nova] Releasing lock "refresh_cache-9554853a-f1b2-4987-98ae-1e0465831d83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:21:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:21:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:21:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:21:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:21:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:21:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkvPLtHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:21:24 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:21:24 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:21:24 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8df2a3-e796-4c82-ba46-7d4975365d9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:21:24 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedad055-f47b-48fb-a97e-e598abd83357]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6] added
Oct 30 11:21:24 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[63371f0c-3ab6-4181-89b3-32b9d6eb2925]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[875ede52-9e0e-4109-ba77-c8815edec933]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pkvPLtHc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pkvPLtHc" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd631b42-4e1f-48cc-856c-b3af309d6fad]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pkvPLtHc'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a4d83e-68ba-4703-8699-6a42becf0217]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b4a1c8-d164-465e-b58b-2f931c18f2db]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 11:21:24 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 11:21:24 user nova-compute[74278]:  {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:21:24 user nova-compute[74278]: WARNING os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 11:21:24 user nova-compute[74278]: 
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fbdf6d-2f6d-4d8b-aef6-9188bad83282]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6, portal: 172.16.0.220,3260]
Oct 30 11:21:24 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6, portal: 172.16.0.220,3260] successful.
Oct 30 11:21:24 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[295b430a-d33b-4232-b933-e4bac16a4a3e]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[914aa80b-ee45-419d-b1cf-295c7a1a7dd6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 (non-flash)
Oct 30 11:21:24 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 (non-flash)
Oct 30 11:21:24 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c68cbd-fe22-4455-b69c-db4b94945baf]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkvPLtHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:21:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:21:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26536333461346532', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:21:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536333461346532', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:21:25 user nova-compute[74278]: DEBUG nova.objects.instance [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'flavor' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:21:25 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:21:25 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:21:25 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:21:25 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:21:25 user nova-compute[74278]:   <serial>f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6</serial>
Oct 30 11:21:25 user nova-compute[74278]: </disk>
Oct 30 11:21:25 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:21:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:21:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:21:26 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No VIF found with MAC fa:16:3e:91:ad:9d, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:21:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-1a73a95b-a44a-4f11-86c7-35c952443135 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.072s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.compute.manager [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:21:27 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Creating image(s)
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Ensure instance console log exists: /opt/stack/data/nova/instances/9554853a-f1b2-4987-98ae-1e0465831d83/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Start _get_guest_xml network_info=[{"id": "85ada461-0fb8-477d-b82e-ad0ed048c150", "address": "fa:16:3e:09:12:f2", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ada461-0f", "ovs_interfaceid": "85ada461-0fb8-477d-b82e-ad0ed048c150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTgBXSyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9554853a-f1b2-4987-98ae-1e0465831d83', 'attached_at': '', 'detached_at': '', 'volume_id': '3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26', 'serial': '3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26'}, 'attachment_id': 'a4ba8ed2-c217-4f1a-a592-5133316e300e', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:21:27 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:21:27 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTgBXSyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:21:27 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:21:27 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:21:27 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cbf06c-a0c7-4f7a-a821-52654c2375e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:21:27 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7055da-3455-4833-8fe4-8bc5ca23c60b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26] added
Oct 30 11:21:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b981f0-b4d7-4e3c-8c0b-48ee24461830]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a1fd92-0dd0-4c98-8555-4257e44356e1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTgBXSyh {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTgBXSyh" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[07819107-2b45-44aa-97c6-ddf15f17aadb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wTgBXSyh'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2d98d3-cab4-455d-8fed-f3a0b63593ac]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccefacc-99d2-4145-a99a-a6d356c69982]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 (non-flash)
Oct 30 11:21:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 (non-flash)
Oct 30 11:21:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6316fa5c-f462-4e8b-b654-99e4935aad68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260]
Oct 30 11:21:27 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260] successful.
Oct 30 11:21:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[513b5400-0078-46be-9a1c-cdc7884f755a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[531aab3c-042f-4d8a-b7e8-5fdc588372df]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 (non-flash)
Oct 30 11:21:27 user nova-compute[74278]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:21:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 (non-flash)
Oct 30 11:21:27 user nova-compute[74278]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:21:27 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[409062c4-19e7-4581-af58-177f983d6a7c]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:27 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:21:28 user nova-compute[74278]: INFO nova.compute.manager [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Detaching volume f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6
Oct 30 11:21:28 user nova-compute[74278]: INFO nova.virt.block_device [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attempting to driver detach volume f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 from mountpoint /dev/vdb
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Attempting to detach device vdb from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:21:28 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:21:28 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:21:28 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:21:28 user nova-compute[74278]:   <serial>f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6</serial>
Oct 30 11:21:28 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:21:28 user nova-compute[74278]: </disk>
Oct 30 11:21:28 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:21:28 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Successfully detached device vdb from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the persistent domain config.
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:21:28 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:21:28 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:21:28 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:21:28 user nova-compute[74278]:   <serial>f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6</serial>
Oct 30 11:21:28 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:21:28 user nova-compute[74278]: </disk>
Oct 30 11:21:28 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTgBXSyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23435383335353537', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435383335353537', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1477436196',display_name='tempest-TestVolumeBootPattern-server-1477436196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1477436196',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwVoOsdyxK0SNJwN4HZdm83195LyA9Z0y2NGjM0FwHB0Pi1YZz1ojqsLwPsv+2VzYnIe6fA5rtOwUJoMGSzNFwd6qP/wjrkBI6PJWy0NWF/x6FOi1/pKN50JcP0R1EE6Q==',key_name='tempest-TestVolumeBootPattern-1784921068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-mhhzjduo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:21:08Z,user_data=None,user_id='e921926b3790497fb9630088c501af82',uuid=9554853a-f1b2-4987-98ae-1e0465831d83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ada461-0fb8-477d-b82e-ad0ed048c150", "address": "fa:16:3e:09:12:f2", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ada461-0f", "ovs_interfaceid": "85ada461-0fb8-477d-b82e-ad0ed048c150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "85ada461-0fb8-477d-b82e-ad0ed048c150", "address": "fa:16:3e:09:12:f2", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ada461-0f", "ovs_interfaceid": "85ada461-0fb8-477d-b82e-ad0ed048c150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:12:f2,bridge_name='br-int',has_traffic_filtering=True,id=85ada461-0fb8-477d-b82e-ad0ed048c150,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ada461-0f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.objects.instance [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lazy-loading 'pci_devices' on Instance uuid 9554853a-f1b2-4987-98ae-1e0465831d83 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:21:28 user nova-compute[74278]:   <uuid>9554853a-f1b2-4987-98ae-1e0465831d83</uuid>
Oct 30 11:21:28 user nova-compute[74278]:   <name>instance-00000030</name>
Oct 30 11:21:28 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:21:28 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:21:28 user nova-compute[74278]:   <metadata>
Oct 30 11:21:28 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:21:28 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:21:28 user nova-compute[74278]:       <nova:name>tempest-TestVolumeBootPattern-server-1477436196</nova:name>
Oct 30 11:21:28 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:21:27</nova:creationTime>
Oct 30 11:21:28 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:21:28 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:21:28 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:21:28 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:21:28 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:21:28 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:21:28 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:21:28 user nova-compute[74278]:       <nova:owner>
Oct 30 11:21:28 user nova-compute[74278]:         <nova:user uuid="e921926b3790497fb9630088c501af82">tempest-TestVolumeBootPattern-2008975673-project-member</nova:user>
Oct 30 11:21:28 user nova-compute[74278]:         <nova:project uuid="59235488214e4149a91d6c2d5a02dd21">tempest-TestVolumeBootPattern-2008975673</nova:project>
Oct 30 11:21:28 user nova-compute[74278]:       </nova:owner>
Oct 30 11:21:28 user nova-compute[74278]:       <nova:ports>
Oct 30 11:21:28 user nova-compute[74278]:         <nova:port uuid="85ada461-0fb8-477d-b82e-ad0ed048c150">
Oct 30 11:21:28 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 30 11:21:28 user nova-compute[74278]:         </nova:port>
Oct 30 11:21:28 user nova-compute[74278]:       </nova:ports>
Oct 30 11:21:28 user nova-compute[74278]:     </nova:instance>
Oct 30 11:21:28 user nova-compute[74278]:   </metadata>
Oct 30 11:21:28 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:21:28 user nova-compute[74278]:     <system>
Oct 30 11:21:28 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:21:28 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:21:28 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:21:28 user nova-compute[74278]:       <entry name="serial">9554853a-f1b2-4987-98ae-1e0465831d83</entry>
Oct 30 11:21:28 user nova-compute[74278]:       <entry name="uuid">9554853a-f1b2-4987-98ae-1e0465831d83</entry>
Oct 30 11:21:28 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:21:28 user nova-compute[74278]:     </system>
Oct 30 11:21:28 user nova-compute[74278]:   </sysinfo>
Oct 30 11:21:28 user nova-compute[74278]:   <os>
Oct 30 11:21:28 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:21:28 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:21:28 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:21:28 user nova-compute[74278]:   </os>
Oct 30 11:21:28 user nova-compute[74278]:   <features>
Oct 30 11:21:28 user nova-compute[74278]:     <acpi/>
Oct 30 11:21:28 user nova-compute[74278]:     <apic/>
Oct 30 11:21:28 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:21:28 user nova-compute[74278]:   </features>
Oct 30 11:21:28 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:21:28 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:21:28 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:21:28 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:21:28 user nova-compute[74278]:   </clock>
Oct 30 11:21:28 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:21:28 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:21:28 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:21:28 user nova-compute[74278]:   </cpu>
Oct 30 11:21:28 user nova-compute[74278]:   <devices>
Oct 30 11:21:28 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:21:28 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:21:28 user nova-compute[74278]:       <source dev="/dev/sdc"/>
Oct 30 11:21:28 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:21:28 user nova-compute[74278]:       <serial>3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26</serial>
Oct 30 11:21:28 user nova-compute[74278]:     </disk>
Oct 30 11:21:28 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:21:28 user nova-compute[74278]:       <mac address="fa:16:3e:09:12:f2"/>
Oct 30 11:21:28 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:21:28 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:21:28 user nova-compute[74278]:       <target dev="tap85ada461-0f"/>
Oct 30 11:21:28 user nova-compute[74278]:     </interface>
Oct 30 11:21:28 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:21:28 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/9554853a-f1b2-4987-98ae-1e0465831d83/console.log" append="off"/>
Oct 30 11:21:28 user nova-compute[74278]:     </serial>
Oct 30 11:21:28 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:21:28 user nova-compute[74278]:     <video>
Oct 30 11:21:28 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:21:28 user nova-compute[74278]:     </video>
Oct 30 11:21:28 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:21:28 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:21:28 user nova-compute[74278]:     </rng>
Oct 30 11:21:28 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:21:28 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:21:28 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:21:28 user nova-compute[74278]:     </memballoon>
Oct 30 11:21:28 user nova-compute[74278]:   </devices>
Oct 30 11:21:28 user nova-compute[74278]: </domain>
Oct 30 11:21:28 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1477436196',display_name='tempest-TestVolumeBootPattern-server-1477436196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1477436196',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwVoOsdyxK0SNJwN4HZdm83195LyA9Z0y2NGjM0FwHB0Pi1YZz1ojqsLwPsv+2VzYnIe6fA5rtOwUJoMGSzNFwd6qP/wjrkBI6PJWy0NWF/x6FOi1/pKN50JcP0R1EE6Q==',key_name='tempest-TestVolumeBootPattern-1784921068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-mhhzjduo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:21:08Z,user_data=None,user_id='e921926b3790497fb9630088c501af82',uuid=9554853a-f1b2-4987-98ae-1e0465831d83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ada461-0fb8-477d-b82e-ad0ed048c150", "address": "fa:16:3e:09:12:f2", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ada461-0f", "ovs_interfaceid": "85ada461-0fb8-477d-b82e-ad0ed048c150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "85ada461-0fb8-477d-b82e-ad0ed048c150", "address": "fa:16:3e:09:12:f2", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ada461-0f", "ovs_interfaceid": "85ada461-0fb8-477d-b82e-ad0ed048c150", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:12:f2,bridge_name='br-int',has_traffic_filtering=True,id=85ada461-0fb8-477d-b82e-ad0ed048c150,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ada461-0f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG os_vif [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:12:f2,bridge_name='br-int',has_traffic_filtering=True,id=85ada461-0fb8-477d-b82e-ad0ed048c150,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ada461-0f') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f768034-eabd-576a-ae4f-28e5b9a30477', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85ada461-0f, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85ada461-0f, col_values=(('qos', UUID('1813474b-b76e-4c9a-aa20-1000dfd24f9b')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85ada461-0f, col_values=(('external_ids', {'iface-id': '85ada461-0fb8-477d-b82e-ad0ed048c150', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:12:f2', 'vm-uuid': '9554853a-f1b2-4987-98ae-1e0465831d83'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:28 user nova-compute[74278]: INFO os_vif [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:12:f2,bridge_name='br-int',has_traffic_filtering=True,id=85ada461-0fb8-477d-b82e-ad0ed048c150,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ada461-0f')
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:21:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] No VIF found with MAC fa:16:3e:09:12:f2, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:21:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-b337f9bf-e069-4013-8c36-d3b58e50cdca req-0c685d56-5762-4e53-b1a4-a3ead60d6bb1 service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Received event network-vif-plugged-85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b337f9bf-e069-4013-8c36-d3b58e50cdca req-0c685d56-5762-4e53-b1a4-a3ead60d6bb1 service nova] Acquiring lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b337f9bf-e069-4013-8c36-d3b58e50cdca req-0c685d56-5762-4e53-b1a4-a3ead60d6bb1 service nova] Lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b337f9bf-e069-4013-8c36-d3b58e50cdca req-0c685d56-5762-4e53-b1a4-a3ead60d6bb1 service nova] Lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG nova.compute.manager [req-b337f9bf-e069-4013-8c36-d3b58e50cdca req-0c685d56-5762-4e53-b1a4-a3ead60d6bb1 service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] No waiting events found dispatching network-vif-plugged-85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:21:30 user nova-compute[74278]: WARNING nova.compute.manager [req-b337f9bf-e069-4013-8c36-d3b58e50cdca req-0c685d56-5762-4e53-b1a4-a3ead60d6bb1 service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Received unexpected event network-vif-plugged-85ada461-0fb8-477d-b82e-ad0ed048c150 for instance with vm_state building and task_state spawning.
Oct 30 11:21:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG nova.compute.manager [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:21:32 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Instance spawned successfully.
Oct 30 11:21:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG nova.compute.manager [req-5b98fe66-e5d9-4481-a698-e2b08fdaba22 req-85f886f1-26df-4b93-bc01-c4193e6b6bfa service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Received event network-vif-plugged-85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5b98fe66-e5d9-4481-a698-e2b08fdaba22 req-85f886f1-26df-4b93-bc01-c4193e6b6bfa service nova] Acquiring lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5b98fe66-e5d9-4481-a698-e2b08fdaba22 req-85f886f1-26df-4b93-bc01-c4193e6b6bfa service nova] Lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5b98fe66-e5d9-4481-a698-e2b08fdaba22 req-85f886f1-26df-4b93-bc01-c4193e6b6bfa service nova] Lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:21:32 user nova-compute[74278]: DEBUG nova.compute.manager [req-5b98fe66-e5d9-4481-a698-e2b08fdaba22 req-85f886f1-26df-4b93-bc01-c4193e6b6bfa service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] No waiting events found dispatching network-vif-plugged-85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:21:32 user nova-compute[74278]: WARNING nova.compute.manager [req-5b98fe66-e5d9-4481-a698-e2b08fdaba22 req-85f886f1-26df-4b93-bc01-c4193e6b6bfa service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Received unexpected event network-vif-plugged-85ada461-0fb8-477d-b82e-ad0ed048c150 for instance with vm_state building and task_state spawning.
Oct 30 11:21:32 user nova-compute[74278]: INFO nova.compute.manager [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Took 5.17 seconds to spawn the instance on the hypervisor.
Oct 30 11:21:32 user nova-compute[74278]: DEBUG nova.compute.manager [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:21:32 user nova-compute[74278]: INFO nova.compute.manager [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Took 25.00 seconds to build instance.
Oct 30 11:21:32 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-18d87c8f-dcd0-439b-a415-08daff88afc1 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "9554853a-f1b2-4987-98ae-1e0465831d83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.097s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:21:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:41 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:21:42 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:21:43 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:21:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:21:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:21:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:21:46 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:21:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:21:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:21:46 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:21:47 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updating instance_info_cache with network_info: [{"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:21:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:21:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:21:47 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:21:47 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:21:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:21:49 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 is timed out.
Oct 30 11:21:49 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Successfully detached device vdb from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the live domain config.
Oct 30 11:21:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkvPLtHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:21:49 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[774f41dc-795f-4b4e-bf5b-dab48207d08a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:21:49 user nova-compute[74278]: No targets found.
Oct 30 11:21:49 user nova-compute[74278]: iSNS:
Oct 30 11:21:49 user nova-compute[74278]: No targets found.
Oct 30 11:21:49 user nova-compute[74278]: STATIC:
Oct 30 11:21:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6
Oct 30 11:21:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:21:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:21:49 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26
Oct 30 11:21:49 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:21:49 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:21:49 user nova-compute[74278]: FIRMWARE:
Oct 30 11:21:49 user nova-compute[74278]: No targets found.
Oct 30 11:21:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:21:49 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:21:49 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d11238f-3c34-4694-8676-8b2e04b35f04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9e0b46-d9ab-4911-8ff3-af096958090f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 (non-flash)
Oct 30 11:21:49 user nova-compute[74278]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:21:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 (non-flash)
Oct 30 11:21:49 user nova-compute[74278]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:21:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c368040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2ca11b-3728-426a-93e0-83801e252dc6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[47593f4b-6c27-45da-8aa0-5d28554ff483]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b85f4b-5659-4001-85b4-8632ce465fa2]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc419b1-f17e-4244-8025-a9d8643330c9]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fe5b4b-200f-4330-982d-4326cabe9777]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e694fa-2dc1-4e83-8155-dc60dd6093dc]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6, portal: 172.16.0.220,3260]
Oct 30 11:21:49 user nova-compute[74278]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6, portal: 172.16.0.220,3260] successful.
Oct 30 11:21:49 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2f8bb81-03a9-4c70-bec6-ce0e2dfb24d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7109761b-9b18-4172-8f40-57e74d2abd48]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] <== disconnect_volume: return (297ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:49 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG nova.objects.instance [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'flavor' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-243d646c-0caf-4792-b0d9-ce4b6cb3575f tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.804s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:21:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:21:51 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:21:51 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:21:51 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8350MB free_disk=24.797382354736328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:21:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:21:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 194af77f-525c-4380-bead-6fbf5e1c7f1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9554853a-f1b2-4987-98ae-1e0465831d83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing inventories for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating ProviderTree inventory for provider ce405684-67ab-45d9-bc83-6af4903bfb15 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating inventory in ProviderTree for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing aggregate associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, aggregates: None {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing trait associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:21:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:21:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:21:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:21:54 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74278) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 11:21:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:21:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:06 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:22:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 11:22:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] There are 0 instances to clean {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'flavor' on Instance uuid 194af77f-525c-4380-bead-6fbf5e1c7f1b {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:22:07 user nova-compute[74278]: INFO nova.compute.manager [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Attaching volume a0927ccf-83ea-431b-8a98-06a4e631c9cc to /dev/vdb
Oct 30 11:22:07 user nova-compute[74278]: DEBUG os_brick.utils [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7441c4b4-89de-4a3b-be4c-1d21c979766e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b61788e-792f-4d38-991f-58f2c3c7d790]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[862893e7-e04d-447f-bfce-a81a9689fcad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[79754a0a-4ac1-4ce6-80a0-b00151b27a45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:22:07 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:22:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3ce313-b13f-42e6-90ef-1811c37b286b]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG os_brick.utils [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:22:07 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updating existing volume attachment record: 64d1c67b-2d49-49bc-bb51-0aa6e9bcd00c {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:22:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:22:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:22:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:22:24 user nova-compute[74278]: DEBUG nova.objects.instance [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'flavor' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:22:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:22:25 user nova-compute[74278]: INFO nova.compute.manager [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attaching volume d3e26f75-c399-4a43-a93e-b8b2951b1840 to /dev/vdb
Oct 30 11:22:25 user nova-compute[74278]: DEBUG os_brick.utils [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dcad9a-6fd1-4d8b-aa17-002a6cdaca6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1864c1b4-eccf-4c5d-b5cc-7c4657272cce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5425ff9a-bf7c-4424-89a4-ea760605cd43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70d9927-d79b-424e-8e23-f87548a5607b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:22:25 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:22:25 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9e29e4-776f-41a9-9463-ef16bc217ff1]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG os_brick.utils [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updating existing volume attachment record: 11b20507-15d5-459b-9d61-f998062f5495 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:22:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkayhrNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:22:37 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:22:37 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:22:37 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0311ea59-e667-41c3-9ca0-f6a2117ad374]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:22:37 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa5660b-55e9-464c-a5c9-eb5d8ebb71a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc] added
Oct 30 11:22:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9eef72-e99e-47d4-95b8-b55fbf70639c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b9538-783e-4a9b-bef2-cd90c44ea913]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OkayhrNe {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OkayhrNe" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4fecee-8ef0-4c0d-a262-b8a72e177f67]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OkayhrNe'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc62493-1e84-4d95-81f5-569b10d1b886]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3378fe17-73c4-4ad0-9aea-6b1278cbb08d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:22:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:22:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f549925b-a427-4f2d-a236-55f235b5fbf6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260]
Oct 30 11:22:37 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260] successful.
Oct 30 11:22:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf36ed6-ca56-4bb1-9792-6ddaa65be5e4]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[909aeb7f-9efa-4724-bf3a-750d5c5e2180]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:22:37 user nova-compute[74278]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:22:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:22:37 user nova-compute[74278]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:22:37 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[be379d9f-172b-4522-bb23-11deeeab9e9a]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:37 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:22:38 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:22:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkayhrNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:22:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:22:38 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23565356565663036', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:22:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565356565663036', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:22:38 user nova-compute[74278]: DEBUG nova.objects.instance [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'flavor' on Instance uuid 194af77f-525c-4380-bead-6fbf5e1c7f1b {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:22:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:22:38 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:22:38 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:22:38 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:22:38 user nova-compute[74278]:   <serial>a0927ccf-83ea-431b-8a98-06a4e631c9cc</serial>
Oct 30 11:22:38 user nova-compute[74278]: </disk>
Oct 30 11:22:38 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:22:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:22:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:22:38 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] No VIF found with MAC fa:16:3e:fb:dc:24, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:22:39 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-cf0f58cb-aca1-4510-80dc-3605e0555112 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.604s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:22:42 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:22:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tEJxKfdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:22:44 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:22:44 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:22:44 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84a363d-ffd0-45ba-9ec1-0093fed1baae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:22:44 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[db14f2ca-b27c-462b-b44a-ad700ad56428]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840] added
Oct 30 11:22:44 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5cfb41-a575-4cdd-abd8-7665e695c103]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6154c9-80b5-4668-8a2c-47cdf303a5b3]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tEJxKfdl {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tEJxKfdl" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[108b1dda-48ba-4212-85e1-bea72427d382]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tEJxKfdl'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e1073b-e3e8-48b0-85e4-8b4dfa6ab9c0]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ea51aa-4eff-4dd6-a200-e3f9eab9df31]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:22:44 user nova-compute[74278]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:22:44 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:22:44 user nova-compute[74278]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:22:44 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[695b251f-688f-4305-b36a-88062e43cde6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840, portal: 172.16.0.220,3260]
Oct 30 11:22:44 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840, portal: 172.16.0.220,3260] successful.
Oct 30 11:22:44 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b61b5b-b609-4aa0-ab48-c9cd43d476ef]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1444d570-bcbe-4276-ba7d-8c3202f14c36]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:22:45 user nova-compute[74278]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:22:45 user nova-compute[74278]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)
Oct 30 11:22:45 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:22:45 user nova-compute[74278]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:22:45 user nova-compute[74278]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)
Oct 30 11:22:45 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbaf148-be03-4602-af32-3e2ac30d164e]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:22:45 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tEJxKfdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23437643736346366', 'path': '/dev/sdd'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437643736346366', 'path': '/dev/sdd'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG nova.objects.instance [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'flavor' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:22:46 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:22:46 user nova-compute[74278]:   <source dev="/dev/sdd"/>
Oct 30 11:22:46 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:22:46 user nova-compute[74278]:   <serial>d3e26f75-c399-4a43-a93e-b8b2951b1840</serial>
Oct 30 11:22:46 user nova-compute[74278]: </disk>
Oct 30 11:22:46 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No VIF found with MAC fa:16:3e:91:ad:9d, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:22:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-319759ab-371b-4080-85b1-53ba666ea658 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.594s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:22:47 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:22:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:22:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:22:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:22:47 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:22:47 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updating instance_info_cache with network_info: [{"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:22:47 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:22:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:22:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:22:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:22:49 user nova-compute[74278]: INFO nova.compute.manager [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Detaching volume d3e26f75-c399-4a43-a93e-b8b2951b1840
Oct 30 11:22:49 user nova-compute[74278]: INFO nova.virt.block_device [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attempting to driver detach volume d3e26f75-c399-4a43-a93e-b8b2951b1840 from mountpoint /dev/vdb
Oct 30 11:22:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Attempting to detach device vdb from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:22:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:22:49 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:22:49 user nova-compute[74278]:   <source dev="/dev/sdd"/>
Oct 30 11:22:49 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:22:49 user nova-compute[74278]:   <serial>d3e26f75-c399-4a43-a93e-b8b2951b1840</serial>
Oct 30 11:22:49 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:22:49 user nova-compute[74278]: </disk>
Oct 30 11:22:49 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:22:49 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Successfully detached device vdb from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the persistent domain config.
Oct 30 11:22:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:22:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:22:49 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:22:49 user nova-compute[74278]:   <source dev="/dev/sdd"/>
Oct 30 11:22:49 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:22:49 user nova-compute[74278]:   <serial>d3e26f75-c399-4a43-a93e-b8b2951b1840</serial>
Oct 30 11:22:49 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:22:49 user nova-compute[74278]: </disk>
Oct 30 11:22:49 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:22:49 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:22:50 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:22:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:22:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:22:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:22:50 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:22:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:22:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:51 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG nova.compute.manager [req-be57bf08-d840-4916-830d-86239a9bdebe req-62e87422-fe49-4464-8e86-c58e6616f49e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-changed-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG nova.compute.manager [req-be57bf08-d840-4916-830d-86239a9bdebe req-62e87422-fe49-4464-8e86-c58e6616f49e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Refreshing instance network info cache due to event network-changed-1ae17add-42be-43af-8b80-754d42bf694d. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-be57bf08-d840-4916-830d-86239a9bdebe req-62e87422-fe49-4464-8e86-c58e6616f49e service nova] Acquiring lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-be57bf08-d840-4916-830d-86239a9bdebe req-62e87422-fe49-4464-8e86-c58e6616f49e service nova] Acquired lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG nova.network.neutron [req-be57bf08-d840-4916-830d-86239a9bdebe req-62e87422-fe49-4464-8e86-c58e6616f49e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Refreshing network info cache for port 1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:22:52 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:22:52 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:22:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8414MB free_disk=24.787525177001953GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 194af77f-525c-4380-bead-6fbf5e1c7f1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 9554853a-f1b2-4987-98ae-1e0465831d83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:22:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:22:53 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:22:53 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:22:53 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:22:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:22:53 user nova-compute[74278]: DEBUG nova.network.neutron [req-be57bf08-d840-4916-830d-86239a9bdebe req-62e87422-fe49-4464-8e86-c58e6616f49e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updated VIF entry in instance network info cache for port 1ae17add-42be-43af-8b80-754d42bf694d. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:22:53 user nova-compute[74278]: DEBUG nova.network.neutron [req-be57bf08-d840-4916-830d-86239a9bdebe req-62e87422-fe49-4464-8e86-c58e6616f49e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updating instance_info_cache with network_info: [{"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:22:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-be57bf08-d840-4916-830d-86239a9bdebe req-62e87422-fe49-4464-8e86-c58e6616f49e service nova] Releasing lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:22:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:22:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:22:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-17db0c32-6784-4af5-b8dc-36a904cff78a req-41f64471-7844-403c-98de-1ee632c6fadd service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-changed-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:22:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-17db0c32-6784-4af5-b8dc-36a904cff78a req-41f64471-7844-403c-98de-1ee632c6fadd service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Refreshing instance network info cache due to event network-changed-1ae17add-42be-43af-8b80-754d42bf694d. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:22:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-17db0c32-6784-4af5-b8dc-36a904cff78a req-41f64471-7844-403c-98de-1ee632c6fadd service nova] Acquiring lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:22:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-17db0c32-6784-4af5-b8dc-36a904cff78a req-41f64471-7844-403c-98de-1ee632c6fadd service nova] Acquired lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:22:54 user nova-compute[74278]: DEBUG nova.network.neutron [req-17db0c32-6784-4af5-b8dc-36a904cff78a req-41f64471-7844-403c-98de-1ee632c6fadd service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Refreshing network info cache for port 1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:22:54 user nova-compute[74278]: DEBUG nova.network.neutron [req-17db0c32-6784-4af5-b8dc-36a904cff78a req-41f64471-7844-403c-98de-1ee632c6fadd service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updated VIF entry in instance network info cache for port 1ae17add-42be-43af-8b80-754d42bf694d. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:22:54 user nova-compute[74278]: DEBUG nova.network.neutron [req-17db0c32-6784-4af5-b8dc-36a904cff78a req-41f64471-7844-403c-98de-1ee632c6fadd service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updating instance_info_cache with network_info: [{"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:22:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-17db0c32-6784-4af5-b8dc-36a904cff78a req-41f64471-7844-403c-98de-1ee632c6fadd service nova] Releasing lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:22:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:57 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:22:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:22:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-847b391f-4152-4ae6-a6b4-22fbcffc1def req-57ac7dfb-d8e2-40ee-9f8d-c4b8e7ebbd9e service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Received event network-changed-85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:22:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-847b391f-4152-4ae6-a6b4-22fbcffc1def req-57ac7dfb-d8e2-40ee-9f8d-c4b8e7ebbd9e service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Refreshing instance network info cache due to event network-changed-85ada461-0fb8-477d-b82e-ad0ed048c150. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:22:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-847b391f-4152-4ae6-a6b4-22fbcffc1def req-57ac7dfb-d8e2-40ee-9f8d-c4b8e7ebbd9e service nova] Acquiring lock "refresh_cache-9554853a-f1b2-4987-98ae-1e0465831d83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:22:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-847b391f-4152-4ae6-a6b4-22fbcffc1def req-57ac7dfb-d8e2-40ee-9f8d-c4b8e7ebbd9e service nova] Acquired lock "refresh_cache-9554853a-f1b2-4987-98ae-1e0465831d83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:22:59 user nova-compute[74278]: DEBUG nova.network.neutron [req-847b391f-4152-4ae6-a6b4-22fbcffc1def req-57ac7dfb-d8e2-40ee-9f8d-c4b8e7ebbd9e service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Refreshing network info cache for port 85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-847b391f-4152-4ae6-a6b4-22fbcffc1def req-57ac7dfb-d8e2-40ee-9f8d-c4b8e7ebbd9e service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Updated VIF entry in instance network info cache for port 85ada461-0fb8-477d-b82e-ad0ed048c150. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-847b391f-4152-4ae6-a6b4-22fbcffc1def req-57ac7dfb-d8e2-40ee-9f8d-c4b8e7ebbd9e service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Updating instance_info_cache with network_info: [{"id": "85ada461-0fb8-477d-b82e-ad0ed048c150", "address": "fa:16:3e:09:12:f2", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ada461-0f", "ovs_interfaceid": "85ada461-0fb8-477d-b82e-ad0ed048c150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-847b391f-4152-4ae6-a6b4-22fbcffc1def req-57ac7dfb-d8e2-40ee-9f8d-c4b8e7ebbd9e service nova] Releasing lock "refresh_cache-9554853a-f1b2-4987-98ae-1e0465831d83" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "9554853a-f1b2-4987-98ae-1e0465831d83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "9554853a-f1b2-4987-98ae-1e0465831d83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:00 user nova-compute[74278]: INFO nova.compute.manager [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Terminating instance
Oct 30 11:23:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-0c7deaa5-9b46-4ff4-b134-dee5f89781ad req-bc1107d7-92ad-4518-8e83-e7d51f18c61f service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Received event network-vif-unplugged-85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0c7deaa5-9b46-4ff4-b134-dee5f89781ad req-bc1107d7-92ad-4518-8e83-e7d51f18c61f service nova] Acquiring lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0c7deaa5-9b46-4ff4-b134-dee5f89781ad req-bc1107d7-92ad-4518-8e83-e7d51f18c61f service nova] Lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0c7deaa5-9b46-4ff4-b134-dee5f89781ad req-bc1107d7-92ad-4518-8e83-e7d51f18c61f service nova] Lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-0c7deaa5-9b46-4ff4-b134-dee5f89781ad req-bc1107d7-92ad-4518-8e83-e7d51f18c61f service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] No waiting events found dispatching network-vif-unplugged-85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-0c7deaa5-9b46-4ff4-b134-dee5f89781ad req-bc1107d7-92ad-4518-8e83-e7d51f18c61f service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Received event network-vif-unplugged-85ada461-0fb8-477d-b82e-ad0ed048c150 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:23:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Instance destroyed successfully.
Oct 30 11:23:01 user nova-compute[74278]: DEBUG nova.objects.instance [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lazy-loading 'resources' on Instance uuid 9554853a-f1b2-4987-98ae-1e0465831d83 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1477436196',display_name='tempest-TestVolumeBootPattern-server-1477436196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1477436196',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwVoOsdyxK0SNJwN4HZdm83195LyA9Z0y2NGjM0FwHB0Pi1YZz1ojqsLwPsv+2VzYnIe6fA5rtOwUJoMGSzNFwd6qP/wjrkBI6PJWy0NWF/x6FOi1/pKN50JcP0R1EE6Q==',key_name='tempest-TestVolumeBootPattern-1784921068',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:21:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-mhhzjduo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:21:33Z,user_data=None,user_id='e921926b3790497fb9630088c501af82',uuid=9554853a-f1b2-4987-98ae-1e0465831d83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85ada461-0fb8-477d-b82e-ad0ed048c150", "address": "fa:16:3e:09:12:f2", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ada461-0f", "ovs_interfaceid": "85ada461-0fb8-477d-b82e-ad0ed048c150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "85ada461-0fb8-477d-b82e-ad0ed048c150", "address": "fa:16:3e:09:12:f2", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ada461-0f", "ovs_interfaceid": "85ada461-0fb8-477d-b82e-ad0ed048c150", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:12:f2,bridge_name='br-int',has_traffic_filtering=True,id=85ada461-0fb8-477d-b82e-ad0ed048c150,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ada461-0f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_vif [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:12:f2,bridge_name='br-int',has_traffic_filtering=True,id=85ada461-0fb8-477d-b82e-ad0ed048c150,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ada461-0f') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85ada461-0f, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1813474b-b76e-4c9a-aa20-1000dfd24f9b) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:23:01 user nova-compute[74278]: INFO os_vif [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:12:f2,bridge_name='br-int',has_traffic_filtering=True,id=85ada461-0fb8-477d-b82e-ad0ed048c150,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ada461-0f')
Oct 30 11:23:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTgBXSyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:23:01 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1403fb42-ffa3-454f-86dc-ca05620158d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:23:01 user nova-compute[74278]: No targets found.
Oct 30 11:23:01 user nova-compute[74278]: iSNS:
Oct 30 11:23:01 user nova-compute[74278]: No targets found.
Oct 30 11:23:01 user nova-compute[74278]: STATIC:
Oct 30 11:23:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26
Oct 30 11:23:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:23:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:23:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc
Oct 30 11:23:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:23:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:23:01 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840
Oct 30 11:23:01 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:23:01 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:23:01 user nova-compute[74278]: FIRMWARE:
Oct 30 11:23:01 user nova-compute[74278]: No targets found.
Oct 30 11:23:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:23:01 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:23:01 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf54586b-f96a-418d-9f89-ad2055719a8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c333f22-05d3-496b-828e-cc92db2c2bed]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:23:01 user nova-compute[74278]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:23:01 user nova-compute[74278]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)
Oct 30 11:23:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:23:01 user nova-compute[74278]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:23:01 user nova-compute[74278]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)
Oct 30 11:23:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c3551b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7550ce87-36f0-466d-a601-b5e88d3f129d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e6da37-59be-4ad1-a01c-e28179f70f95]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1252f0-b534-4a31-80b2-3b87310102b9]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a429b6-997e-4b1c-90f7-5fa8241dc4d6]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf2d26a56-4583555716f6f652', '/dev/disk/by-id/scsi-23435383335353537', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f2d26a56') {{(pid=85487) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[47258f2d-346f-4538-821f-e88f1c5042e4]: (4, None) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2544b0b7-e2a8-4007-a4a0-7fd731c37ba5]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c851a7-c51b-4512-9f02-39537130523a]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260]
Oct 30 11:23:01 user nova-compute[74278]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260] successful.
Oct 30 11:23:01 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c963d3-460e-4f09-9052-b19ea921692f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== disconnect_volume: return (293ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:23:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Deleting instance files /opt/stack/data/nova/instances/9554853a-f1b2-4987-98ae-1e0465831d83_del
Oct 30 11:23:01 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Deletion of /opt/stack/data/nova/instances/9554853a-f1b2-4987-98ae-1e0465831d83_del complete
Oct 30 11:23:01 user nova-compute[74278]: INFO nova.compute.manager [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 30 11:23:01 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:23:01 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:23:02 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:23:02 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Took 1.22 seconds to deallocate network for instance.
Oct 30 11:23:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-cb629380-1f01-4757-9d3a-ff5472b4e384 req-95004e40-0be4-4cd4-8dad-48addcc66532 service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Received event network-vif-deleted-85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-c298e0c9-a7cb-475c-a8e6-7bb6235918df req-47e8bcfb-c441-4c80-b2bd-193c257d9f9f service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Received event network-vif-plugged-85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c298e0c9-a7cb-475c-a8e6-7bb6235918df req-47e8bcfb-c441-4c80-b2bd-193c257d9f9f service nova] Acquiring lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c298e0c9-a7cb-475c-a8e6-7bb6235918df req-47e8bcfb-c441-4c80-b2bd-193c257d9f9f service nova] Lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c298e0c9-a7cb-475c-a8e6-7bb6235918df req-47e8bcfb-c441-4c80-b2bd-193c257d9f9f service nova] Lock "9554853a-f1b2-4987-98ae-1e0465831d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-c298e0c9-a7cb-475c-a8e6-7bb6235918df req-47e8bcfb-c441-4c80-b2bd-193c257d9f9f service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] No waiting events found dispatching network-vif-plugged-85ada461-0fb8-477d-b82e-ad0ed048c150 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:02 user nova-compute[74278]: WARNING nova.compute.manager [req-c298e0c9-a7cb-475c-a8e6-7bb6235918df req-47e8bcfb-c441-4c80-b2bd-193c257d9f9f service nova] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Received unexpected event network-vif-plugged-85ada461-0fb8-477d-b82e-ad0ed048c150 for instance with vm_state active and task_state deleting.
Oct 30 11:23:03 user nova-compute[74278]: INFO nova.compute.manager [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Rescuing
Oct 30 11:23:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:23:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquired lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:23:03 user nova-compute[74278]: DEBUG nova.network.neutron [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:23:03 user nova-compute[74278]: DEBUG nova.network.neutron [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updating instance_info_cache with network_info: [{"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:23:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Releasing lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:23:03 user nova-compute[74278]: INFO nova.compute.manager [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 9554853a-f1b2-4987-98ae-1e0465831d83] Took 0.87 seconds to detach 1 volumes for instance.
Oct 30 11:23:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:04 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Deleted allocations for instance 9554853a-f1b2-4987-98ae-1e0465831d83
Oct 30 11:23:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-48797165-1443-48d2-b208-d64d68fc75dc tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "9554853a-f1b2-4987-98ae-1e0465831d83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.716s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Instance destroyed successfully.
Oct 30 11:23:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Attempting rescue
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74278) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Instance directory exists: not creating {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 11:23:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Creating image(s)
Oct 30 11:23:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "/opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "/opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "/opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.rescue {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.rescue" returned: 0 in 0.172s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'migration_context' on Instance uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.objects.base [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<8cafd05d-e81c-4f9d-975d-f18bd37f8eb9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Start _get_guest_xml network_info=[{"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "vif_mac": "fa:16:3e:81:a3:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4107584d-f654-453b-972a-abcf1c7a0671', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'resources' on Instance uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.objects.base [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<8cafd05d-e81c-4f9d-975d-f18bd37f8eb9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'numa_topology' on Instance uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.objects.base [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<8cafd05d-e81c-4f9d-975d-f18bd37f8eb9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:23:04 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:23:04 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.objects.base [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<8cafd05d-e81c-4f9d-975d-f18bd37f8eb9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1317166121',display_name='tempest-ServerRescueNegativeTestJSON-server-1317166121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1317166121',id=45,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:18:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a881207e0d4a4314a979e3af56cf2f95',ramdisk_id='',reservation_id='r-si04jmc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2065673492',owner_user_name='tempest-ServerRescueNegativeTestJSON-2065673492-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:18:24Z,user_data=None,user_id='8ad932a451724349a5c40964d7e75157',uuid=8cafd05d-e81c-4f9d-975d-f18bd37f8eb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "vif_mac": "fa:16:3e:81:a3:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converting VIF {"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "vif_mac": "fa:16:3e:81:a3:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:a3:4a,bridge_name='br-int',has_traffic_filtering=True,id=5e58a9e9-0fbe-41b9-9795-0de8d50150b3,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e58a9e9-0f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.objects.base [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<8cafd05d-e81c-4f9d-975d-f18bd37f8eb9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:23:04 user nova-compute[74278]:   <uuid>8cafd05d-e81c-4f9d-975d-f18bd37f8eb9</uuid>
Oct 30 11:23:04 user nova-compute[74278]:   <name>instance-0000002d</name>
Oct 30 11:23:04 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:23:04 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:23:04 user nova-compute[74278]:   <metadata>
Oct 30 11:23:04 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:23:04 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:23:04 user nova-compute[74278]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1317166121</nova:name>
Oct 30 11:23:04 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:23:04</nova:creationTime>
Oct 30 11:23:04 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:23:04 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:23:04 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:23:04 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:23:04 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:23:04 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:23:04 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:23:04 user nova-compute[74278]:       <nova:owner>
Oct 30 11:23:04 user nova-compute[74278]:         <nova:user uuid="8ad932a451724349a5c40964d7e75157">tempest-ServerRescueNegativeTestJSON-2065673492-project-member</nova:user>
Oct 30 11:23:04 user nova-compute[74278]:         <nova:project uuid="a881207e0d4a4314a979e3af56cf2f95">tempest-ServerRescueNegativeTestJSON-2065673492</nova:project>
Oct 30 11:23:04 user nova-compute[74278]:       </nova:owner>
Oct 30 11:23:04 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:23:04 user nova-compute[74278]:       <nova:ports>
Oct 30 11:23:04 user nova-compute[74278]:         <nova:port uuid="5e58a9e9-0fbe-41b9-9795-0de8d50150b3">
Oct 30 11:23:04 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 11:23:04 user nova-compute[74278]:         </nova:port>
Oct 30 11:23:04 user nova-compute[74278]:       </nova:ports>
Oct 30 11:23:04 user nova-compute[74278]:     </nova:instance>
Oct 30 11:23:04 user nova-compute[74278]:   </metadata>
Oct 30 11:23:04 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:23:04 user nova-compute[74278]:     <system>
Oct 30 11:23:04 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:23:04 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:23:04 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:23:04 user nova-compute[74278]:       <entry name="serial">8cafd05d-e81c-4f9d-975d-f18bd37f8eb9</entry>
Oct 30 11:23:04 user nova-compute[74278]:       <entry name="uuid">8cafd05d-e81c-4f9d-975d-f18bd37f8eb9</entry>
Oct 30 11:23:04 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:23:04 user nova-compute[74278]:     </system>
Oct 30 11:23:04 user nova-compute[74278]:   </sysinfo>
Oct 30 11:23:04 user nova-compute[74278]:   <os>
Oct 30 11:23:04 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:23:04 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:23:04 user nova-compute[74278]:   </os>
Oct 30 11:23:04 user nova-compute[74278]:   <features>
Oct 30 11:23:04 user nova-compute[74278]:     <acpi/>
Oct 30 11:23:04 user nova-compute[74278]:     <apic/>
Oct 30 11:23:04 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:23:04 user nova-compute[74278]:   </features>
Oct 30 11:23:04 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:23:04 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:23:04 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:23:04 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:23:04 user nova-compute[74278]:   </clock>
Oct 30 11:23:04 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:23:04 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:23:04 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:23:04 user nova-compute[74278]:   </cpu>
Oct 30 11:23:04 user nova-compute[74278]:   <devices>
Oct 30 11:23:04 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:23:04 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:23:04 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.rescue"/>
Oct 30 11:23:04 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:23:04 user nova-compute[74278]:     </disk>
Oct 30 11:23:04 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:23:04 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:23:04 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk"/>
Oct 30 11:23:04 user nova-compute[74278]:       <target dev="vdb" bus="virtio"/>
Oct 30 11:23:04 user nova-compute[74278]:     </disk>
Oct 30 11:23:04 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:23:04 user nova-compute[74278]:       <mac address="fa:16:3e:81:a3:4a"/>
Oct 30 11:23:04 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:23:04 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:23:04 user nova-compute[74278]:       <target dev="tap5e58a9e9-0f"/>
Oct 30 11:23:04 user nova-compute[74278]:     </interface>
Oct 30 11:23:04 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:23:04 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/console.log" append="off"/>
Oct 30 11:23:04 user nova-compute[74278]:     </serial>
Oct 30 11:23:04 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:23:04 user nova-compute[74278]:     <video>
Oct 30 11:23:04 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:23:04 user nova-compute[74278]:     </video>
Oct 30 11:23:04 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:23:04 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:23:04 user nova-compute[74278]:     </rng>
Oct 30 11:23:04 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:23:04 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:23:04 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:23:04 user nova-compute[74278]:     </memballoon>
Oct 30 11:23:04 user nova-compute[74278]:   </devices>
Oct 30 11:23:04 user nova-compute[74278]: </domain>
Oct 30 11:23:04 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:23:04 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Instance destroyed successfully.
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:23:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No VIF found with MAC fa:16:3e:81:a3:4a, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-unplugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-unplugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:05 user nova-compute[74278]: WARNING nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-unplugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state active and task_state rescuing.
Oct 30 11:23:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:05 user nova-compute[74278]: WARNING nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state active and task_state rescuing.
Oct 30 11:23:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:05 user nova-compute[74278]: WARNING nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state active and task_state rescuing.
Oct 30 11:23:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:05 user nova-compute[74278]: WARNING nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state active and task_state rescuing.
Oct 30 11:23:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-unplugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-unplugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:05 user nova-compute[74278]: WARNING nova.compute.manager [req-84102544-39a7-40bc-aec5-867a213f5ccd req-983ef504-a783-4456-af48-9c5c1d17a60d service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-unplugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state active and task_state rescuing.
Oct 30 11:23:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:05 user nova-compute[74278]: INFO nova.compute.manager [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Rebooting instance
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquired lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:23:05 user nova-compute[74278]: DEBUG nova.network.neutron [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updating instance_info_cache with network_info: [{"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Releasing lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-0b95ba2b-5f27-4117-8d5c-af7e09cc8eaa req-0aad6084-ba3f-4e8b-8fe9-6c3264990877 service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-unplugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0b95ba2b-5f27-4117-8d5c-af7e09cc8eaa req-0aad6084-ba3f-4e8b-8fe9-6c3264990877 service nova] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0b95ba2b-5f27-4117-8d5c-af7e09cc8eaa req-0aad6084-ba3f-4e8b-8fe9-6c3264990877 service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0b95ba2b-5f27-4117-8d5c-af7e09cc8eaa req-0aad6084-ba3f-4e8b-8fe9-6c3264990877 service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:06 user nova-compute[74278]: DEBUG nova.compute.manager [req-0b95ba2b-5f27-4117-8d5c-af7e09cc8eaa req-0aad6084-ba3f-4e8b-8fe9-6c3264990877 service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] No waiting events found dispatching network-vif-unplugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:06 user nova-compute[74278]: WARNING nova.compute.manager [req-0b95ba2b-5f27-4117-8d5c-af7e09cc8eaa req-0aad6084-ba3f-4e8b-8fe9-6c3264990877 service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received unexpected event network-vif-unplugged-1ae17add-42be-43af-8b80-754d42bf694d for instance with vm_state active and task_state reboot_started_hard.
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:07 user nova-compute[74278]: WARNING nova.compute.manager [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state active and task_state rescuing.
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:07 user nova-compute[74278]: WARNING nova.compute.manager [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state active and task_state rescuing.
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:07 user nova-compute[74278]: WARNING nova.compute.manager [req-a69292f6-dfc5-4b21-860f-1e14b36719c4 req-f578a06c-944d-4a7b-aebe-da50e2f7e4db service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state active and task_state rescuing.
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Instance destroyed successfully.
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'resources' on Instance uuid 194af77f-525c-4380-bead-6fbf5e1c7f1b {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1731798367',display_name='tempest-TestMinimumBasicScenario-server-1731798367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1731798367',id=47,image_ref='800f0d78-b4c0-4c66-b73f-cb80861926dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxqPXVbuWiMlqYwfdErsmIIeIdNcrv3FqgQHQiihR1KMqooUkXPHLGwgb6OJJ4LmUjJypR/tWEYQurczPvIbbMlbzyUN/UyinQ7hkTZ6KZernIXGRzIY8KVINElc3sYmg==',key_name='tempest-TestMinimumBasicScenario-1479820048',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbe8ef99a57b49049a3266b974ba661b',ramdisk_id='',reservation_id='r-jhg7w6qw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800f0d78-b4c0-4c66-b73f-cb80861926dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-274954723',owner_user_name='tempest-TestMinimumBasicScenario-274954723-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:23:06Z,user_data=None,user_id='03fb7307a64e4bcfb24ad4d337e12688',uuid=194af77f-525c-4380-bead-6fbf5e1c7f1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converting VIF {"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_vif [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ae17add-42, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8c0cb75-ff07-4265-8821-9680b1ee0a96) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: INFO os_vif [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42')
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkayhrNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:23:07 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[db46533a-6ea8-4db1-af8f-afd2dac2e32c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:23:07 user nova-compute[74278]: No targets found.
Oct 30 11:23:07 user nova-compute[74278]: iSNS:
Oct 30 11:23:07 user nova-compute[74278]: No targets found.
Oct 30 11:23:07 user nova-compute[74278]: STATIC:
Oct 30 11:23:07 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc
Oct 30 11:23:07 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:23:07 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:23:07 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840
Oct 30 11:23:07 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:23:07 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:23:07 user nova-compute[74278]: FIRMWARE:
Oct 30 11:23:07 user nova-compute[74278]: No targets found.
Oct 30 11:23:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:23:07 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:23:07 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[95016dc4-7c39-4eeb-8ba7-b8077d79b91a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0dd519-f2d2-497e-b6af-a9e1ea459c20]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:23:07 user nova-compute[74278]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)
Oct 30 11:23:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:23:07 user nova-compute[74278]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)
Oct 30 11:23:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac5b8f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9361b3-42b4-42bd-97a5-9760657e00fe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe18fe9-3885-4b70-b7ea-d3fae55f88a4]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2143d6e-4e86-4f15-b745-85bcb4c224a1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33cdb8e-b699-4d17-9b3a-8797a2c0eef0]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b3a24e-3a2a-4e80-b833-755cf2e9b9f8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[314ee94e-1a11-453c-aee8-6f24914e5af3]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260]
Oct 30 11:23:07 user nova-compute[74278]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260] successful.
Oct 30 11:23:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be39665-7bef-47bf-93cf-807012af233a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] <== disconnect_volume: return (359ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Start _get_guest_xml network_info=[{"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=800f0d78-b4c0-4c66-b73f-cb80861926dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '800f0d78-b4c0-4c66-b73f-cb80861926dd'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkayhrNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '194af77f-525c-4380-bead-6fbf5e1c7f1b', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0927ccf-83ea-431b-8a98-06a4e631c9cc', 'serial': 'a0927ccf-83ea-431b-8a98-06a4e631c9cc'}, 'attachment_id': '64d1c67b-2d49-49bc-bb51-0aa6e9bcd00c', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:23:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:23:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=800f0d78-b4c0-4c66-b73f-cb80861926dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'vcpu_model' on Instance uuid 194af77f-525c-4380-bead-6fbf5e1c7f1b {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.objects.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Object Instance<194af77f-525c-4380-bead-6fbf5e1c7f1b> lazy-loaded attributes: resources,vcpu_model {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkayhrNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:23:07 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:23:07 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:23:07 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7229d955-780a-4d78-8866-92ab1cfe01a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:23:07 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[274ae3cf-14a6-4e3b-b29f-01040f6f7c44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc] added
Oct 30 11:23:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e9f982-1188-43d7-be01-f8b6d55c6d4d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28a25f7-3c98-4034-8f17-f0486ba2abc3]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OkayhrNe {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OkayhrNe" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8357ce5c-1bed-4b29-8bcf-bb90375654d8]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OkayhrNe'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[575072b1-1305-4e5f-8164-833d97332923]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[24861cfc-f660-4d07-8a8a-65ee61a60d9b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)
Oct 30 11:23:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)
Oct 30 11:23:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcf4d69-e25c-4f27-a875-0937cc644af6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260]
Oct 30 11:23:07 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260] successful.
Oct 30 11:23:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9910f2bc-8848-4de8-aecb-38c6faf04984]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ea7fe2-bfda-438d-af7a-6a19e700bfc8]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)
Oct 30 11:23:07 user nova-compute[74278]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:23:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)
Oct 30 11:23:07 user nova-compute[74278]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:23:07 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a629532b-cfdc-49cb-a8bf-6f3bc9ba318a]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:23:07 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkayhrNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-a34ee07d-293a-4413-b53f-f18d5646a868 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] No waiting events found dispatching network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:08 user nova-compute[74278]: WARNING nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received unexpected event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d for instance with vm_state active and task_state reboot_started_hard.
Oct 30 11:23:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] No waiting events found dispatching network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:08 user nova-compute[74278]: WARNING nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received unexpected event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d for instance with vm_state active and task_state reboot_started_hard.
Oct 30 11:23:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] No waiting events found dispatching network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:08 user nova-compute[74278]: WARNING nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received unexpected event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d for instance with vm_state active and task_state reboot_started_hard.
Oct 30 11:23:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-unplugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] No waiting events found dispatching network-vif-unplugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:08 user nova-compute[74278]: WARNING nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received unexpected event network-vif-unplugged-1ae17add-42be-43af-8b80-754d42bf694d for instance with vm_state active and task_state reboot_started_hard.
Oct 30 11:23:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] No waiting events found dispatching network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:08 user nova-compute[74278]: WARNING nova.compute.manager [req-c39b53b7-8327-4d17-be40-389ad5b49a84 req-e4d76838-6d8c-4044-b6c9-f659fe072d6e service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received unexpected event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d for instance with vm_state active and task_state reboot_started_hard.
Oct 30 11:23:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23565356565663036', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:23:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565356565663036', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1731798367',display_name='tempest-TestMinimumBasicScenario-server-1731798367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1731798367',id=47,image_ref='800f0d78-b4c0-4c66-b73f-cb80861926dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxqPXVbuWiMlqYwfdErsmIIeIdNcrv3FqgQHQiihR1KMqooUkXPHLGwgb6OJJ4LmUjJypR/tWEYQurczPvIbbMlbzyUN/UyinQ7hkTZ6KZernIXGRzIY8KVINElc3sYmg==',key_name='tempest-TestMinimumBasicScenario-1479820048',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbe8ef99a57b49049a3266b974ba661b',ramdisk_id='',reservation_id='r-jhg7w6qw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800f0d78-b4c0-4c66-b73f-cb80861926dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-274954723',owner_user_name='tempest-TestMinimumBasicScenario-274954723-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:23:06Z,user_data=None,user_id='03fb7307a64e4bcfb24ad4d337e12688',uuid=194af77f-525c-4380-bead-6fbf5e1c7f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converting VIF {"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'pci_devices' on Instance uuid 194af77f-525c-4380-bead-6fbf5e1c7f1b {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.objects.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Object Instance<194af77f-525c-4380-bead-6fbf5e1c7f1b> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:23:09 user nova-compute[74278]:   <uuid>194af77f-525c-4380-bead-6fbf5e1c7f1b</uuid>
Oct 30 11:23:09 user nova-compute[74278]:   <name>instance-0000002f</name>
Oct 30 11:23:09 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:23:09 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:23:09 user nova-compute[74278]:   <metadata>
Oct 30 11:23:09 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:23:09 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:23:09 user nova-compute[74278]:       <nova:name>tempest-TestMinimumBasicScenario-server-1731798367</nova:name>
Oct 30 11:23:09 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:23:07</nova:creationTime>
Oct 30 11:23:09 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:23:09 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:23:09 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:23:09 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:23:09 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:23:09 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:23:09 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:23:09 user nova-compute[74278]:       <nova:owner>
Oct 30 11:23:09 user nova-compute[74278]:         <nova:user uuid="03fb7307a64e4bcfb24ad4d337e12688">tempest-TestMinimumBasicScenario-274954723-project-member</nova:user>
Oct 30 11:23:09 user nova-compute[74278]:         <nova:project uuid="dbe8ef99a57b49049a3266b974ba661b">tempest-TestMinimumBasicScenario-274954723</nova:project>
Oct 30 11:23:09 user nova-compute[74278]:       </nova:owner>
Oct 30 11:23:09 user nova-compute[74278]:       <nova:root type="image" uuid="800f0d78-b4c0-4c66-b73f-cb80861926dd"/>
Oct 30 11:23:09 user nova-compute[74278]:       <nova:ports>
Oct 30 11:23:09 user nova-compute[74278]:         <nova:port uuid="1ae17add-42be-43af-8b80-754d42bf694d">
Oct 30 11:23:09 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 11:23:09 user nova-compute[74278]:         </nova:port>
Oct 30 11:23:09 user nova-compute[74278]:       </nova:ports>
Oct 30 11:23:09 user nova-compute[74278]:     </nova:instance>
Oct 30 11:23:09 user nova-compute[74278]:   </metadata>
Oct 30 11:23:09 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:23:09 user nova-compute[74278]:     <system>
Oct 30 11:23:09 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:23:09 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:23:09 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:23:09 user nova-compute[74278]:       <entry name="serial">194af77f-525c-4380-bead-6fbf5e1c7f1b</entry>
Oct 30 11:23:09 user nova-compute[74278]:       <entry name="uuid">194af77f-525c-4380-bead-6fbf5e1c7f1b</entry>
Oct 30 11:23:09 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:23:09 user nova-compute[74278]:     </system>
Oct 30 11:23:09 user nova-compute[74278]:   </sysinfo>
Oct 30 11:23:09 user nova-compute[74278]:   <os>
Oct 30 11:23:09 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:23:09 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:23:09 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:23:09 user nova-compute[74278]:   </os>
Oct 30 11:23:09 user nova-compute[74278]:   <features>
Oct 30 11:23:09 user nova-compute[74278]:     <acpi/>
Oct 30 11:23:09 user nova-compute[74278]:     <apic/>
Oct 30 11:23:09 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:23:09 user nova-compute[74278]:   </features>
Oct 30 11:23:09 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:23:09 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:23:09 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:23:09 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:23:09 user nova-compute[74278]:   </clock>
Oct 30 11:23:09 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:23:09 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:23:09 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:23:09 user nova-compute[74278]:   </cpu>
Oct 30 11:23:09 user nova-compute[74278]:   <devices>
Oct 30 11:23:09 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:23:09 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:23:09 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk"/>
Oct 30 11:23:09 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:23:09 user nova-compute[74278]:     </disk>
Oct 30 11:23:09 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:23:09 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:23:09 user nova-compute[74278]:       <source dev="/dev/sdb"/>
Oct 30 11:23:09 user nova-compute[74278]:       <target dev="vdb" bus="virtio"/>
Oct 30 11:23:09 user nova-compute[74278]:       <serial>a0927ccf-83ea-431b-8a98-06a4e631c9cc</serial>
Oct 30 11:23:09 user nova-compute[74278]:     </disk>
Oct 30 11:23:09 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:23:09 user nova-compute[74278]:       <mac address="fa:16:3e:fb:dc:24"/>
Oct 30 11:23:09 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:23:09 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:23:09 user nova-compute[74278]:       <target dev="tap1ae17add-42"/>
Oct 30 11:23:09 user nova-compute[74278]:     </interface>
Oct 30 11:23:09 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:23:09 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/console.log" append="off"/>
Oct 30 11:23:09 user nova-compute[74278]:     </serial>
Oct 30 11:23:09 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:23:09 user nova-compute[74278]:     <video>
Oct 30 11:23:09 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:23:09 user nova-compute[74278]:     </video>
Oct 30 11:23:09 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:23:09 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:23:09 user nova-compute[74278]:     </rng>
Oct 30 11:23:09 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:23:09 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:23:09 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:23:09 user nova-compute[74278]:     </memballoon>
Oct 30 11:23:09 user nova-compute[74278]:   </devices>
Oct 30 11:23:09 user nova-compute[74278]: </domain>
Oct 30 11:23:09 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'trusted_certs' on Instance uuid 194af77f-525c-4380-bead-6fbf5e1c7f1b {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.objects.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Object Instance<194af77f-525c-4380-bead-6fbf5e1c7f1b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:09 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 is timed out.
Oct 30 11:23:09 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Successfully detached device vdb from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the live domain config.
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tEJxKfdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:23:09 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:23:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40b878f-1df9-46ab-ab76-1fa27e52395f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:23:09 user nova-compute[74278]: No targets found.
Oct 30 11:23:09 user nova-compute[74278]: iSNS:
Oct 30 11:23:09 user nova-compute[74278]: No targets found.
Oct 30 11:23:09 user nova-compute[74278]: STATIC:
Oct 30 11:23:09 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc
Oct 30 11:23:09 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:23:09 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:23:09 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840
Oct 30 11:23:09 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:23:09 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:23:09 user nova-compute[74278]: FIRMWARE:
Oct 30 11:23:09 user nova-compute[74278]: No targets found.
Oct 30 11:23:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:23:09 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:23:09 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116 --force-share --output=json" returned: 0 in 0.194s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a833205c-9bf4-4d75-8b0f-eecbee0a3bb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4958ea3-2995-4e83-a8f2-eb1246573341]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)
Oct 30 11:23:09 user nova-compute[74278]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:23:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 (non-flash)
Oct 30 11:23:09 user nova-compute[74278]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:23:09 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c75f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840'): ({'sdd'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Removing single pathed devices sdd {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4bfaaf-9186-4de9-ade7-a9b6d2e1399e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7988dd6f-eab2-481b-bfc4-c7794e175efe]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Flushing IO for device /dev/sdd {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[815a81aa-d46d-4ff3-bea0-0308ff7f66c0]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Cannot resize image /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:23:09 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'migration_context' on Instance uuid 194af77f-525c-4380-bead-6fbf5e1c7f1b {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.063s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5132df8-6398-4444-af45-c30b61b271dd]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG nova.objects.base [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Object Instance<194af77f-525c-4380-bead-6fbf5e1c7f1b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1731798367',display_name='tempest-TestMinimumBasicScenario-server-1731798367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1731798367',id=47,image_ref='800f0d78-b4c0-4c66-b73f-cb80861926dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxqPXVbuWiMlqYwfdErsmIIeIdNcrv3FqgQHQiihR1KMqooUkXPHLGwgb6OJJ4LmUjJypR/tWEYQurczPvIbbMlbzyUN/UyinQ7hkTZ6KZernIXGRzIY8KVINElc3sYmg==',key_name='tempest-TestMinimumBasicScenario-1479820048',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='dbe8ef99a57b49049a3266b974ba661b',ramdisk_id='',reservation_id='r-jhg7w6qw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800f0d78-b4c0-4c66-b73f-cb80861926dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-274954723',owner_user_name='tempest-TestMinimumBasicScenario-274954723-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:23:06Z,user_data=None,user_id='03fb7307a64e4bcfb24ad4d337e12688',uuid=194af77f-525c-4380-bead-6fbf5e1c7f1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converting VIF {"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG os_vif [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40a759e7-5e4c-55f9-960c-ee6e791f4adf', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3d48bd-d0e5-4cdb-8bc8-18b197c9a903]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ae17add-42, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ae17add-42, col_values=(('qos', UUID('1eafaae3-e328-4daa-b125-0b6a0e3650cf')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ae17add-42, col_values=(('external_ids', {'iface-id': '1ae17add-42be-43af-8b80-754d42bf694d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:dc:24', 'vm-uuid': '194af77f-525c-4380-bead-6fbf5e1c7f1b'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:10 user nova-compute[74278]: INFO os_vif [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42')
Oct 30 11:23:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9e1410-128e-4cc0-afec-1f6ebb6e6ef4]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840, portal: 172.16.0.220,3260]
Oct 30 11:23:10 user nova-compute[74278]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840, portal: 172.16.0.220,3260] successful.
Oct 30 11:23:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3e26f75-c399-4a43-a93e-b8b2951b1840 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e918d2b-68f9-49b1-bca1-2cfa089eeb23]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] <== disconnect_volume: return (409ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:23:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:11 user nova-compute[74278]: DEBUG nova.objects.instance [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'flavor' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-810da04f-65bc-4c5a-a922-dfc5f9cfed66 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.915s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-f6e069ff-590c-4e68-99af-cfcba587f835 req-6979c46d-9f1b-4ea5-8f80-e3479b43956b service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f6e069ff-590c-4e68-99af-cfcba587f835 req-6979c46d-9f1b-4ea5-8f80-e3479b43956b service nova] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f6e069ff-590c-4e68-99af-cfcba587f835 req-6979c46d-9f1b-4ea5-8f80-e3479b43956b service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f6e069ff-590c-4e68-99af-cfcba587f835 req-6979c46d-9f1b-4ea5-8f80-e3479b43956b service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-f6e069ff-590c-4e68-99af-cfcba587f835 req-6979c46d-9f1b-4ea5-8f80-e3479b43956b service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] No waiting events found dispatching network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:11 user nova-compute[74278]: WARNING nova.compute.manager [req-f6e069ff-590c-4e68-99af-cfcba587f835 req-6979c46d-9f1b-4ea5-8f80-e3479b43956b service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received unexpected event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d for instance with vm_state active and task_state reboot_started_hard.
Oct 30 11:23:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-43b6f0bd-5b7f-495a-bc49-f17fc8921cdc req-a8b49066-f7f6-4e35-9d1d-b2081d1d27f7 service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-43b6f0bd-5b7f-495a-bc49-f17fc8921cdc req-a8b49066-f7f6-4e35-9d1d-b2081d1d27f7 service nova] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-43b6f0bd-5b7f-495a-bc49-f17fc8921cdc req-a8b49066-f7f6-4e35-9d1d-b2081d1d27f7 service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-43b6f0bd-5b7f-495a-bc49-f17fc8921cdc req-a8b49066-f7f6-4e35-9d1d-b2081d1d27f7 service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-43b6f0bd-5b7f-495a-bc49-f17fc8921cdc req-a8b49066-f7f6-4e35-9d1d-b2081d1d27f7 service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] No waiting events found dispatching network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:23:13 user nova-compute[74278]: WARNING nova.compute.manager [req-43b6f0bd-5b7f-495a-bc49-f17fc8921cdc req-a8b49066-f7f6-4e35-9d1d-b2081d1d27f7 service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received unexpected event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d for instance with vm_state active and task_state reboot_started_hard.
Oct 30 11:23:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:23:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Instance rebooted successfully.
Oct 30 11:23:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:23:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9f3e8640-3473-4f04-9a6a-a41ddffb68e4 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.290s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:23:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:23:44 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:23:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:45 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'flavor' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:46 user nova-compute[74278]: INFO nova.compute.manager [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attaching volume d5a2bd7a-33bf-48d6-ab02-28968c8df090 to /dev/vdb
Oct 30 11:23:46 user nova-compute[74278]: DEBUG os_brick.utils [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6685003-9646-434b-938f-0064a08e6f47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[852e4dd1-d7ad-41d6-9468-6e4798103709]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dce93c0-6b17-4d28-ad41-44f887bd8cd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e6666b-8701-4b5b-a8ff-f400824277d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:23:46 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:23:46 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae29f6d0-e5f3-46d1-85b1-101087902afb]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG os_brick.utils [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:23:46 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updating existing volume attachment record: a45653aa-47eb-4360-bc31-1fe298532c69 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:23:48 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:23:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:23:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 11:23:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:23:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:23:48 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:23:48 user nova-compute[74278]: DEBUG nova.objects.instance [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lazy-loading 'info_cache' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:23:48 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updating instance_info_cache with network_info: [{"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:23:48 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-4338fbe0-d9f1-4425-a2fc-72c78d4bce34" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:23:48 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:23:48 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:23:48 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:23:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:51 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:23:51 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "30695565-3d1f-48b8-b85a-19f9e9a28196" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG nova.compute.manager [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:23:52 user nova-compute[74278]: INFO nova.compute.claims [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Claim successful on node user
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG nova.compute.manager [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.089s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG nova.compute.manager [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG nova.network.neutron [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:23:52 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:23:52 user nova-compute[74278]: DEBUG nova.compute.manager [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG nova.policy [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e921926b3790497fb9630088c501af82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59235488214e4149a91d6c2d5a02dd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:23:52 user nova-compute[74278]: INFO nova.virt.block_device [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Booting with volume 3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 at /dev/vda
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG os_brick.utils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddd5f81-3771-4c92-b238-f1c3ed2d98b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d25386-57e8-4d6e-a458-c01c8aebe933]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[268e39f0-3980-4a95-ac8b-caa98821c8a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf064bd-6985-407d-b4cc-5b10f5a2c517]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:23:52 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:23:53 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3dbad4-87d5-4031-b513-144794f374e5]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG os_brick.utils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== get_connector_properties: return (242ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Updating existing volume attachment record: 068d4095-8773-4a5b-9aa7-9a811f9524a6 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG nova.network.neutron [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Successfully created port: 96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Successfully updated port: 96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "refresh_cache-30695565-3d1f-48b8-b85a-19f9e9a28196" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquired lock "refresh_cache-30695565-3d1f-48b8-b85a-19f9e9a28196" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-8e292d4e-8c19-4701-8847-c0c0ed91becf req-3e5ee26d-6ee6-4472-b994-0a6b689ff82e service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Received event network-changed-96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-8e292d4e-8c19-4701-8847-c0c0ed91becf req-3e5ee26d-6ee6-4472-b994-0a6b689ff82e service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Refreshing instance network info cache due to event network-changed-96d00d41-05f1-4e9c-8cea-b85bf7a79187. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8e292d4e-8c19-4701-8847-c0c0ed91becf req-3e5ee26d-6ee6-4472-b994-0a6b689ff82e service nova] Acquiring lock "refresh_cache-30695565-3d1f-48b8-b85a-19f9e9a28196" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Updating instance_info_cache with network_info: [{"id": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "address": "fa:16:3e:d6:95:88", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d00d41-05", "ovs_interfaceid": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Releasing lock "refresh_cache-30695565-3d1f-48b8-b85a-19f9e9a28196" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG nova.compute.manager [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Instance network_info: |[{"id": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "address": "fa:16:3e:d6:95:88", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d00d41-05", "ovs_interfaceid": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8e292d4e-8c19-4701-8847-c0c0ed91becf req-3e5ee26d-6ee6-4472-b994-0a6b689ff82e service nova] Acquired lock "refresh_cache-30695565-3d1f-48b8-b85a-19f9e9a28196" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:23:54 user nova-compute[74278]: DEBUG nova.network.neutron [req-8e292d4e-8c19-4701-8847-c0c0ed91becf req-3e5ee26d-6ee6-4472-b994-0a6b689ff82e service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Refreshing network info cache for port 96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:23:55 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:23:55 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8474MB free_disk=24.783466339111328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 194af77f-525c-4380-bead-6fbf5e1c7f1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 30695565-3d1f-48b8-b85a-19f9e9a28196 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-8e292d4e-8c19-4701-8847-c0c0ed91becf req-3e5ee26d-6ee6-4472-b994-0a6b689ff82e service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Updated VIF entry in instance network info cache for port 96d00d41-05f1-4e9c-8cea-b85bf7a79187. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-8e292d4e-8c19-4701-8847-c0c0ed91becf req-3e5ee26d-6ee6-4472-b994-0a6b689ff82e service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Updating instance_info_cache with network_info: [{"id": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "address": "fa:16:3e:d6:95:88", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d00d41-05", "ovs_interfaceid": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-8e292d4e-8c19-4701-8847-c0c0ed91becf req-3e5ee26d-6ee6-4472-b994-0a6b689ff82e service nova] Releasing lock "refresh_cache-30695565-3d1f-48b8-b85a-19f9e9a28196" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:23:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:24:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:24:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:24:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:24:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:24:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUdIkhXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:24:05 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:24:05 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:24:05 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[589d1eef-e57c-4a75-be3f-f7e883267591]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:24:05 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb27d8e-b46d-406f-b982-8d0ab072fbde]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090] added
Oct 30 11:24:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea91587e-66e8-48cb-9eab-01151eafdbdf]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9aa507-a1b5-44be-aed6-b076d5c5121e]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUdIkhXp {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUdIkhXp" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8094d8-6b86-483b-96bf-2f88768b7a2a]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LUdIkhXp'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed0de3a-80b4-4184-b29e-423e83b97c0f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2f1e25-e62c-45f9-89e6-5312b6219de6]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:24:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:24:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e8a6bd-1b25-4eee-aaa3-721d9d4086bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090, portal: 172.16.0.220,3260]
Oct 30 11:24:05 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090, portal: 172.16.0.220,3260] successful.
Oct 30 11:24:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdcce27-427e-4a64-8632-aa9c91220b3f]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b762ae6-2a80-4554-a386-df0d6a3d3f34]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:24:05 user nova-compute[74278]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 (non-flash)
Oct 30 11:24:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:24:05 user nova-compute[74278]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 (non-flash)
Oct 30 11:24:05 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2fd8b5-4cfa-434d-8b2f-c4373d98d51e]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:24:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUdIkhXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:24:06 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:24:06 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26262646166663766', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:24:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262646166663766', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:24:06 user nova-compute[74278]: DEBUG nova.objects.instance [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'flavor' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:24:06 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:24:06 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:24:06 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:24:06 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:24:06 user nova-compute[74278]:   <serial>d5a2bd7a-33bf-48d6-ab02-28968c8df090</serial>
Oct 30 11:24:06 user nova-compute[74278]: </disk>
Oct 30 11:24:06 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:24:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:24:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:24:07 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] No VIF found with MAC fa:16:3e:91:ad:9d, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:24:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-a0f54189-f8c5-46b0-a760-caffa9e252f9 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.018s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:24:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:24:09 user nova-compute[74278]: INFO nova.compute.manager [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Detaching volume d5a2bd7a-33bf-48d6-ab02-28968c8df090
Oct 30 11:24:09 user nova-compute[74278]: INFO nova.virt.block_device [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Attempting to driver detach volume d5a2bd7a-33bf-48d6-ab02-28968c8df090 from mountpoint /dev/vdb
Oct 30 11:24:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Attempting to detach device vdb from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:24:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:24:09 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:24:09 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:24:09 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:24:09 user nova-compute[74278]:   <serial>d5a2bd7a-33bf-48d6-ab02-28968c8df090</serial>
Oct 30 11:24:09 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:24:09 user nova-compute[74278]: </disk>
Oct 30 11:24:09 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:24:09 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Successfully detached device vdb from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the persistent domain config.
Oct 30 11:24:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:24:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:24:09 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:24:09 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:24:09 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:24:09 user nova-compute[74278]:   <serial>d5a2bd7a-33bf-48d6-ab02-28968c8df090</serial>
Oct 30 11:24:09 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:24:09 user nova-compute[74278]: </disk>
Oct 30 11:24:09 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:24:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:24:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:24:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:24:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:24:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:24:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:24:12 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Creating image(s)
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Ensure instance console log exists: /opt/stack/data/nova/instances/30695565-3d1f-48b8-b85a-19f9e9a28196/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Start _get_guest_xml network_info=[{"id": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "address": "fa:16:3e:d6:95:88", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d00d41-05", "ovs_interfaceid": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTgBXSyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '30695565-3d1f-48b8-b85a-19f9e9a28196', 'attached_at': '', 'detached_at': '', 'volume_id': '3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26', 'serial': '3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26'}, 'attachment_id': '068d4095-8773-4a5b-9aa7-9a811f9524a6', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:24:12 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:24:12 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTgBXSyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:24:12 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:24:12 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:24:12 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dcdd8c-c6b0-41dc-8b54-e5b8ce25ad72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:24:12 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f26c069-64b4-481e-8733-f5af7a471dd8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26] added
Oct 30 11:24:12 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[50284cf3-cdd7-4f66-b72b-b8c4d5366ccc]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5deaab-6048-4b10-9221-b13b50892a40]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTgBXSyh {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTgBXSyh" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[81edcae0-d375-4517-b095-4291ff8633ea]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wTgBXSyh'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6608127-811a-45cb-a8c4-c3f1359e0d71]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1199319-ef7b-43f1-b1ef-8fbf64e97cdb]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:24:12 user nova-compute[74278]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 (non-flash)
Oct 30 11:24:12 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:24:12 user nova-compute[74278]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 (non-flash)
Oct 30 11:24:12 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4c0ff0-94bf-47f4-8dfe-4e52a9ea1774]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260]
Oct 30 11:24:12 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260] successful.
Oct 30 11:24:12 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fad26fd-1309-4db3-af07-bbbc9f31af35]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[985890d9-95ce-43df-ab9f-7f02a3b5053b]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:24:12 user nova-compute[74278]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 (non-flash)
Oct 30 11:24:12 user nova-compute[74278]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:24:12 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:24:12 user nova-compute[74278]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 (non-flash)
Oct 30 11:24:12 user nova-compute[74278]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:24:12 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b98cd95-49a0-4e40-8a21-01aff970d194]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:12 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: None {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTgBXSyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23435383335353537', 'path': '/dev/sdd'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435383335353537', 'path': '/dev/sdd'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:23:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2111827443',display_name='tempest-TestVolumeBootPattern-server-2111827443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2111827443',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwVoOsdyxK0SNJwN4HZdm83195LyA9Z0y2NGjM0FwHB0Pi1YZz1ojqsLwPsv+2VzYnIe6fA5rtOwUJoMGSzNFwd6qP/wjrkBI6PJWy0NWF/x6FOi1/pKN50JcP0R1EE6Q==',key_name='tempest-TestVolumeBootPattern-1784921068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-8d22jvvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:23:53Z,user_data=None,user_id='e921926b3790497fb9630088c501af82',uuid=30695565-3d1f-48b8-b85a-19f9e9a28196,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "address": "fa:16:3e:d6:95:88", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d00d41-05", "ovs_interfaceid": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "address": "fa:16:3e:d6:95:88", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d00d41-05", "ovs_interfaceid": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:95:88,bridge_name='br-int',has_traffic_filtering=True,id=96d00d41-05f1-4e9c-8cea-b85bf7a79187,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d00d41-05') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG nova.objects.instance [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lazy-loading 'pci_devices' on Instance uuid 30695565-3d1f-48b8-b85a-19f9e9a28196 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:24:13 user nova-compute[74278]:   <uuid>30695565-3d1f-48b8-b85a-19f9e9a28196</uuid>
Oct 30 11:24:13 user nova-compute[74278]:   <name>instance-00000031</name>
Oct 30 11:24:13 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:24:13 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:24:13 user nova-compute[74278]:   <metadata>
Oct 30 11:24:13 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:24:13 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:24:13 user nova-compute[74278]:       <nova:name>tempest-TestVolumeBootPattern-server-2111827443</nova:name>
Oct 30 11:24:13 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:24:12</nova:creationTime>
Oct 30 11:24:13 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:24:13 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:24:13 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:24:13 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:24:13 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:24:13 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:24:13 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:24:13 user nova-compute[74278]:       <nova:owner>
Oct 30 11:24:13 user nova-compute[74278]:         <nova:user uuid="e921926b3790497fb9630088c501af82">tempest-TestVolumeBootPattern-2008975673-project-member</nova:user>
Oct 30 11:24:13 user nova-compute[74278]:         <nova:project uuid="59235488214e4149a91d6c2d5a02dd21">tempest-TestVolumeBootPattern-2008975673</nova:project>
Oct 30 11:24:13 user nova-compute[74278]:       </nova:owner>
Oct 30 11:24:13 user nova-compute[74278]:       <nova:ports>
Oct 30 11:24:13 user nova-compute[74278]:         <nova:port uuid="96d00d41-05f1-4e9c-8cea-b85bf7a79187">
Oct 30 11:24:13 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 11:24:13 user nova-compute[74278]:         </nova:port>
Oct 30 11:24:13 user nova-compute[74278]:       </nova:ports>
Oct 30 11:24:13 user nova-compute[74278]:     </nova:instance>
Oct 30 11:24:13 user nova-compute[74278]:   </metadata>
Oct 30 11:24:13 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:24:13 user nova-compute[74278]:     <system>
Oct 30 11:24:13 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:24:13 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:24:13 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:24:13 user nova-compute[74278]:       <entry name="serial">30695565-3d1f-48b8-b85a-19f9e9a28196</entry>
Oct 30 11:24:13 user nova-compute[74278]:       <entry name="uuid">30695565-3d1f-48b8-b85a-19f9e9a28196</entry>
Oct 30 11:24:13 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:24:13 user nova-compute[74278]:     </system>
Oct 30 11:24:13 user nova-compute[74278]:   </sysinfo>
Oct 30 11:24:13 user nova-compute[74278]:   <os>
Oct 30 11:24:13 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:24:13 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:24:13 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:24:13 user nova-compute[74278]:   </os>
Oct 30 11:24:13 user nova-compute[74278]:   <features>
Oct 30 11:24:13 user nova-compute[74278]:     <acpi/>
Oct 30 11:24:13 user nova-compute[74278]:     <apic/>
Oct 30 11:24:13 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:24:13 user nova-compute[74278]:   </features>
Oct 30 11:24:13 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:24:13 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:24:13 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:24:13 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:24:13 user nova-compute[74278]:   </clock>
Oct 30 11:24:13 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:24:13 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:24:13 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:24:13 user nova-compute[74278]:   </cpu>
Oct 30 11:24:13 user nova-compute[74278]:   <devices>
Oct 30 11:24:13 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:24:13 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:24:13 user nova-compute[74278]:       <source dev="/dev/sdd"/>
Oct 30 11:24:13 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:24:13 user nova-compute[74278]:       <serial>3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26</serial>
Oct 30 11:24:13 user nova-compute[74278]:     </disk>
Oct 30 11:24:13 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:24:13 user nova-compute[74278]:       <mac address="fa:16:3e:d6:95:88"/>
Oct 30 11:24:13 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:24:13 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:24:13 user nova-compute[74278]:       <target dev="tap96d00d41-05"/>
Oct 30 11:24:13 user nova-compute[74278]:     </interface>
Oct 30 11:24:13 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:24:13 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/30695565-3d1f-48b8-b85a-19f9e9a28196/console.log" append="off"/>
Oct 30 11:24:13 user nova-compute[74278]:     </serial>
Oct 30 11:24:13 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:24:13 user nova-compute[74278]:     <video>
Oct 30 11:24:13 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:24:13 user nova-compute[74278]:     </video>
Oct 30 11:24:13 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:24:13 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:24:13 user nova-compute[74278]:     </rng>
Oct 30 11:24:13 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:24:13 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:24:13 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:24:13 user nova-compute[74278]:     </memballoon>
Oct 30 11:24:13 user nova-compute[74278]:   </devices>
Oct 30 11:24:13 user nova-compute[74278]: </domain>
Oct 30 11:24:13 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:23:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2111827443',display_name='tempest-TestVolumeBootPattern-server-2111827443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2111827443',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwVoOsdyxK0SNJwN4HZdm83195LyA9Z0y2NGjM0FwHB0Pi1YZz1ojqsLwPsv+2VzYnIe6fA5rtOwUJoMGSzNFwd6qP/wjrkBI6PJWy0NWF/x6FOi1/pKN50JcP0R1EE6Q==',key_name='tempest-TestVolumeBootPattern-1784921068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-8d22jvvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:23:53Z,user_data=None,user_id='e921926b3790497fb9630088c501af82',uuid=30695565-3d1f-48b8-b85a-19f9e9a28196,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "address": "fa:16:3e:d6:95:88", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d00d41-05", "ovs_interfaceid": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "address": "fa:16:3e:d6:95:88", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d00d41-05", "ovs_interfaceid": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:95:88,bridge_name='br-int',has_traffic_filtering=True,id=96d00d41-05f1-4e9c-8cea-b85bf7a79187,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d00d41-05') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG os_vif [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:95:88,bridge_name='br-int',has_traffic_filtering=True,id=96d00d41-05f1-4e9c-8cea-b85bf7a79187,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d00d41-05') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebd086fc-2774-5be9-ba00-920d16b9fc14', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96d00d41-05, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96d00d41-05, col_values=(('qos', UUID('c84255c5-6bb0-452e-b1a1-1f91882cb416')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96d00d41-05, col_values=(('external_ids', {'iface-id': '96d00d41-05f1-4e9c-8cea-b85bf7a79187', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:95:88', 'vm-uuid': '30695565-3d1f-48b8-b85a-19f9e9a28196'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:13 user nova-compute[74278]: INFO os_vif [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:95:88,bridge_name='br-int',has_traffic_filtering=True,id=96d00d41-05f1-4e9c-8cea-b85bf7a79187,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d00d41-05')
Oct 30 11:24:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:24:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] No VIF found with MAC fa:16:3e:d6:95:88, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:24:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-5083ff16-02e9-40b1-804d-afb470426e59 req-a0b80329-5544-4e72-aedc-f8f55d87856d service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Received event network-vif-plugged-96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:24:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5083ff16-02e9-40b1-804d-afb470426e59 req-a0b80329-5544-4e72-aedc-f8f55d87856d service nova] Acquiring lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:24:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5083ff16-02e9-40b1-804d-afb470426e59 req-a0b80329-5544-4e72-aedc-f8f55d87856d service nova] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:24:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-5083ff16-02e9-40b1-804d-afb470426e59 req-a0b80329-5544-4e72-aedc-f8f55d87856d service nova] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-5083ff16-02e9-40b1-804d-afb470426e59 req-a0b80329-5544-4e72-aedc-f8f55d87856d service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] No waiting events found dispatching network-vif-plugged-96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:24:15 user nova-compute[74278]: WARNING nova.compute.manager [req-5083ff16-02e9-40b1-804d-afb470426e59 req-a0b80329-5544-4e72-aedc-f8f55d87856d service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Received unexpected event network-vif-plugged-96d00d41-05f1-4e9c-8cea-b85bf7a79187 for instance with vm_state building and task_state spawning.
Oct 30 11:24:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:24:17 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Instance spawned successfully.
Oct 30 11:24:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:24:17 user nova-compute[74278]: INFO nova.compute.manager [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Took 4.86 seconds to spawn the instance on the hypervisor.
Oct 30 11:24:17 user nova-compute[74278]: DEBUG nova.compute.manager [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-cf070b9a-afb8-44c3-902a-54d98273d841 req-5ac5eb8d-82cd-4630-a058-6aca4e3ba8c9 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Received event network-vif-plugged-96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-cf070b9a-afb8-44c3-902a-54d98273d841 req-5ac5eb8d-82cd-4630-a058-6aca4e3ba8c9 service nova] Acquiring lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-cf070b9a-afb8-44c3-902a-54d98273d841 req-5ac5eb8d-82cd-4630-a058-6aca4e3ba8c9 service nova] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-cf070b9a-afb8-44c3-902a-54d98273d841 req-5ac5eb8d-82cd-4630-a058-6aca4e3ba8c9 service nova] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-cf070b9a-afb8-44c3-902a-54d98273d841 req-5ac5eb8d-82cd-4630-a058-6aca4e3ba8c9 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] No waiting events found dispatching network-vif-plugged-96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:24:17 user nova-compute[74278]: WARNING nova.compute.manager [req-cf070b9a-afb8-44c3-902a-54d98273d841 req-5ac5eb8d-82cd-4630-a058-6aca4e3ba8c9 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Received unexpected event network-vif-plugged-96d00d41-05f1-4e9c-8cea-b85bf7a79187 for instance with vm_state building and task_state spawning.
Oct 30 11:24:17 user nova-compute[74278]: INFO nova.compute.manager [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Took 25.10 seconds to build instance.
Oct 30 11:24:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6ae1b6f8-ff17-44f6-b74c-de90a74d3cc8 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.191s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:24:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:24:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:24:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:24:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:29 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 is timed out.
Oct 30 11:24:29 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Successfully detached device vdb from instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 from the live domain config.
Oct 30 11:24:29 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUdIkhXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:24:29 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:24:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d42721b-be20-4ff5-91cc-f67a03f49b93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:24:29 user nova-compute[74278]: No targets found.
Oct 30 11:24:29 user nova-compute[74278]: iSNS:
Oct 30 11:24:29 user nova-compute[74278]: No targets found.
Oct 30 11:24:29 user nova-compute[74278]: STATIC:
Oct 30 11:24:29 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090
Oct 30 11:24:29 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:24:29 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:24:29 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26
Oct 30 11:24:29 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:24:29 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:24:29 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc
Oct 30 11:24:29 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:24:29 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:24:29 user nova-compute[74278]: FIRMWARE:
Oct 30 11:24:29 user nova-compute[74278]: No targets found.
Oct 30 11:24:29 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:24:29 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:24:29 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bc6893-eece-4296-9730-dafc34d6e630]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[baef9dea-8d5b-4607-8cbc-1ac498921c38]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:24:29 user nova-compute[74278]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 (non-flash)
Oct 30 11:24:29 user nova-compute[74278]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:24:29 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:24:29 user nova-compute[74278]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 (non-flash)
Oct 30 11:24:29 user nova-compute[74278]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:24:29 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c3557e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9f47e0-9f5d-4315-abf5-35e90ecede52]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:29 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2898a45-3573-4739-9b5b-bcf64725a747]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d22b7e0-9f01-4b3b-9eba-03d271a85a56]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb90a93-bc5b-48f1-a6be-fcec0a4ff153]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ae014c-6970-4ca7-b3f8-92e8a584e830]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd841bb-3fa9-4d78-9c30-44b18f933845]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090, portal: 172.16.0.220,3260]
Oct 30 11:24:30 user nova-compute[74278]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090, portal: 172.16.0.220,3260] successful.
Oct 30 11:24:30 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5a2bd7a-33bf-48d6-ab02-28968c8df090 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74611e4-3e84-4f09-ac0c-9f220cef9f1b]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] <== disconnect_volume: return (306ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:24:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:31 user nova-compute[74278]: DEBUG nova.objects.instance [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'flavor' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:24:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-c251e7e0-39dd-41a9-84b4-9ff5bfda029a tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.979s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:49 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:24:49 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:24:49 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:24:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:24:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:24:49 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:24:50 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updating instance_info_cache with network_info: [{"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:24:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:24:50 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:24:50 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:24:50 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:24:50 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:24:50 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:24:50 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:24:52 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:24:53 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:24:53 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:24:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:24:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:24:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:53 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:24:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:54 user nova-compute[74278]: INFO nova.compute.manager [None req-67eec87c-b4af-448d-9bce-1a73928b55d3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Unrescuing
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-67eec87c-b4af-448d-9bce-1a73928b55d3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-67eec87c-b4af-448d-9bce-1a73928b55d3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquired lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-67eec87c-b4af-448d-9bce-1a73928b55d3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-67eec87c-b4af-448d-9bce-1a73928b55d3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updating instance_info_cache with network_info: [{"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-67eec87c-b4af-448d-9bce-1a73928b55d3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Releasing lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG nova.objects.instance [None req-67eec87c-b4af-448d-9bce-1a73928b55d3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'flavor' on Instance uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-608bd77a-4b84-416e-947c-f06f233e84fd req-d199f1bb-54fa-4f14-b390-bd93521a5fc8 service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-unplugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-608bd77a-4b84-416e-947c-f06f233e84fd req-d199f1bb-54fa-4f14-b390-bd93521a5fc8 service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-608bd77a-4b84-416e-947c-f06f233e84fd req-d199f1bb-54fa-4f14-b390-bd93521a5fc8 service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-608bd77a-4b84-416e-947c-f06f233e84fd req-d199f1bb-54fa-4f14-b390-bd93521a5fc8 service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-608bd77a-4b84-416e-947c-f06f233e84fd req-d199f1bb-54fa-4f14-b390-bd93521a5fc8 service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-unplugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:24:54 user nova-compute[74278]: WARNING nova.compute.manager [req-608bd77a-4b84-416e-947c-f06f233e84fd req-d199f1bb-54fa-4f14-b390-bd93521a5fc8 service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-unplugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state rescued and task_state unrescuing.
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:55 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Instance destroyed successfully.
Oct 30 11:24:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:24:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-f7f37692-0222-401a-acb4-c1ceb64ef271 req-f90329e4-1c13-424b-96e0-a96564c0f63b service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f7f37692-0222-401a-acb4-c1ceb64ef271 req-f90329e4-1c13-424b-96e0-a96564c0f63b service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f7f37692-0222-401a-acb4-c1ceb64ef271 req-f90329e4-1c13-424b-96e0-a96564c0f63b service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f7f37692-0222-401a-acb4-c1ceb64ef271 req-f90329e4-1c13-424b-96e0-a96564c0f63b service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-f7f37692-0222-401a-acb4-c1ceb64ef271 req-f90329e4-1c13-424b-96e0-a96564c0f63b service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:24:59 user nova-compute[74278]: WARNING nova.compute.manager [req-f7f37692-0222-401a-acb4-c1ceb64ef271 req-f90329e4-1c13-424b-96e0-a96564c0f63b service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state rescued and task_state unrescuing.
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-f7f37692-0222-401a-acb4-c1ceb64ef271 req-f90329e4-1c13-424b-96e0-a96564c0f63b service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f7f37692-0222-401a-acb4-c1ceb64ef271 req-f90329e4-1c13-424b-96e0-a96564c0f63b service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f7f37692-0222-401a-acb4-c1ceb64ef271 req-f90329e4-1c13-424b-96e0-a96564c0f63b service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-f7f37692-0222-401a-acb4-c1ceb64ef271 req-f90329e4-1c13-424b-96e0-a96564c0f63b service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-f7f37692-0222-401a-acb4-c1ceb64ef271 req-f90329e4-1c13-424b-96e0-a96564c0f63b service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:24:59 user nova-compute[74278]: WARNING nova.compute.manager [req-f7f37692-0222-401a-acb4-c1ceb64ef271 req-f90329e4-1c13-424b-96e0-a96564c0f63b service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state rescued and task_state unrescuing.
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-680e7975-86f4-4921-946d-94fc13349dc1 req-933941f4-fdb1-4c19-8241-2c115abd059c service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-changed-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-680e7975-86f4-4921-946d-94fc13349dc1 req-933941f4-fdb1-4c19-8241-2c115abd059c service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Refreshing instance network info cache due to event network-changed-1ae17add-42be-43af-8b80-754d42bf694d. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-680e7975-86f4-4921-946d-94fc13349dc1 req-933941f4-fdb1-4c19-8241-2c115abd059c service nova] Acquiring lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-680e7975-86f4-4921-946d-94fc13349dc1 req-933941f4-fdb1-4c19-8241-2c115abd059c service nova] Acquired lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.network.neutron [req-680e7975-86f4-4921-946d-94fc13349dc1 req-933941f4-fdb1-4c19-8241-2c115abd059c service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Refreshing network info cache for port 1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:24:59 user nova-compute[74278]: WARNING nova.compute.manager [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state rescued and task_state unrescuing.
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-changed-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Refreshing instance network info cache due to event network-changed-1ae17add-42be-43af-8b80-754d42bf694d. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] Acquiring lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-67eec87c-b4af-448d-9bce-1a73928b55d3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:24:59 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:24:59 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8365MB free_disk=24.781475067138672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:24:59 user nova-compute[74278]: INFO nova.compute.manager [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Detaching volume a0927ccf-83ea-431b-8a98-06a4e631c9cc
Oct 30 11:24:59 user nova-compute[74278]: INFO nova.virt.block_device [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Attempting to driver detach volume a0927ccf-83ea-431b-8a98-06a4e631c9cc from mountpoint /dev/vdb
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 194af77f-525c-4380-bead-6fbf5e1c7f1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 30695565-3d1f-48b8-b85a-19f9e9a28196 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Attempting to detach device vdb from instance 194af77f-525c-4380-bead-6fbf5e1c7f1b from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:24:59 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:24:59 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:24:59 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:24:59 user nova-compute[74278]:   <serial>a0927ccf-83ea-431b-8a98-06a4e631c9cc</serial>
Oct 30 11:24:59 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 11:24:59 user nova-compute[74278]: </disk>
Oct 30 11:24:59 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:24:59 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Successfully detached device vdb from instance 194af77f-525c-4380-bead-6fbf5e1c7f1b from the persistent domain config.
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 194af77f-525c-4380-bead-6fbf5e1c7f1b from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:24:59 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:24:59 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:24:59 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:24:59 user nova-compute[74278]:   <serial>a0927ccf-83ea-431b-8a98-06a4e631c9cc</serial>
Oct 30 11:24:59 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 11:24:59 user nova-compute[74278]: </disk>
Oct 30 11:24:59 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.network.neutron [req-680e7975-86f4-4921-946d-94fc13349dc1 req-933941f4-fdb1-4c19-8241-2c115abd059c service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updated VIF entry in instance network info cache for port 1ae17add-42be-43af-8b80-754d42bf694d. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.network.neutron [req-680e7975-86f4-4921-946d-94fc13349dc1 req-933941f4-fdb1-4c19-8241-2c115abd059c service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updating instance_info_cache with network_info: [{"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-680e7975-86f4-4921-946d-94fc13349dc1 req-933941f4-fdb1-4c19-8241-2c115abd059c service nova] Releasing lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] Acquired lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.network.neutron [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Refreshing network info cache for port 1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:24:59 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 194af77f-525c-4380-bead-6fbf5e1c7f1b {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:25:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updated VIF entry in instance network info cache for port 1ae17add-42be-43af-8b80-754d42bf694d. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:25:00 user nova-compute[74278]: DEBUG nova.network.neutron [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updating instance_info_cache with network_info: [{"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:25:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-859adb2f-024f-4e6b-b199-041f0f4d3836 req-7ed78bd8-8513-42f9-b4b7-d963612d60eb service nova] Releasing lock "refresh_cache-194af77f-525c-4380-bead-6fbf5e1c7f1b" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:25:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:08 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:25:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:19 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 194af77f-525c-4380-bead-6fbf5e1c7f1b is timed out.
Oct 30 11:25:19 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Successfully detached device vdb from instance 194af77f-525c-4380-bead-6fbf5e1c7f1b from the live domain config.
Oct 30 11:25:19 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkayhrNe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:25:19 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:25:19 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[28be75f8-bddc-4107-a786-ffa4919a6849]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:25:19 user nova-compute[74278]: No targets found.
Oct 30 11:25:19 user nova-compute[74278]: iSNS:
Oct 30 11:25:19 user nova-compute[74278]: No targets found.
Oct 30 11:25:19 user nova-compute[74278]: STATIC:
Oct 30 11:25:19 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26
Oct 30 11:25:19 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:25:19 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:25:19 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc
Oct 30 11:25:19 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:25:19 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:25:19 user nova-compute[74278]: FIRMWARE:
Oct 30 11:25:19 user nova-compute[74278]: No targets found.
Oct 30 11:25:19 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:25:19 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:25:19 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[4866d07b-d4fc-4bd3-a7f7-4fa14e3300c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[57123ca7-f916-4124-b593-628ca7b3d1a9]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:25:19 user nova-compute[74278]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:25:19 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc (non-flash)
Oct 30 11:25:19 user nova-compute[74278]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:25:19 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c3540d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0de492-c575-4938-9ae7-ecde2dac2665]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3634aed0-31ad-41a8-b617-12b65b569a6e]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[29293d0e-be90-42aa-878c-6059867d4082]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:25:19 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc29ca1a-6366-419b-af5b-c6926b04252a]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bed4e4-96ac-4349-899b-89c95b0b887d]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[68578bc5-d536-4136-91e4-1146c37cf859]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260]
Oct 30 11:25:20 user nova-compute[74278]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc, portal: 172.16.0.220,3260] successful.
Oct 30 11:25:20 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0927ccf-83ea-431b-8a98-06a4e631c9cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ae0b70-4097-4cb6-b1ee-64d69d43d523]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] <== disconnect_volume: return (295ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:25:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:21 user nova-compute[74278]: DEBUG nova.objects.instance [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'flavor' on Instance uuid 194af77f-525c-4380-bead-6fbf5e1c7f1b {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:25:21 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6cfcf7e9-8ede-4c1d-90a1-33bc9cd4a679 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.061s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:25:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-96680ce1-a107-4f8f-895c-0e92600df327 req-4a39c48f-d51f-40da-8059-076e4ad0cfd1 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Received event network-changed-96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:25:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-96680ce1-a107-4f8f-895c-0e92600df327 req-4a39c48f-d51f-40da-8059-076e4ad0cfd1 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Refreshing instance network info cache due to event network-changed-96d00d41-05f1-4e9c-8cea-b85bf7a79187. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:25:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-96680ce1-a107-4f8f-895c-0e92600df327 req-4a39c48f-d51f-40da-8059-076e4ad0cfd1 service nova] Acquiring lock "refresh_cache-30695565-3d1f-48b8-b85a-19f9e9a28196" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:25:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-96680ce1-a107-4f8f-895c-0e92600df327 req-4a39c48f-d51f-40da-8059-076e4ad0cfd1 service nova] Acquired lock "refresh_cache-30695565-3d1f-48b8-b85a-19f9e9a28196" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:25:43 user nova-compute[74278]: DEBUG nova.network.neutron [req-96680ce1-a107-4f8f-895c-0e92600df327 req-4a39c48f-d51f-40da-8059-076e4ad0cfd1 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Refreshing network info cache for port 96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:25:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:25:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:25:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:25:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:25:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-96680ce1-a107-4f8f-895c-0e92600df327 req-4a39c48f-d51f-40da-8059-076e4ad0cfd1 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Updated VIF entry in instance network info cache for port 96d00d41-05f1-4e9c-8cea-b85bf7a79187. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:25:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-96680ce1-a107-4f8f-895c-0e92600df327 req-4a39c48f-d51f-40da-8059-076e4ad0cfd1 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Updating instance_info_cache with network_info: [{"id": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "address": "fa:16:3e:d6:95:88", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d00d41-05", "ovs_interfaceid": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:25:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-96680ce1-a107-4f8f-895c-0e92600df327 req-4a39c48f-d51f-40da-8059-076e4ad0cfd1 service nova] Releasing lock "refresh_cache-30695565-3d1f-48b8-b85a-19f9e9a28196" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:25:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:25:47 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:25:47 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:25:48 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:25:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:50 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:25:50 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:25:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:25:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:25:50 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:25:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:50 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updating instance_info_cache with network_info: [{"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:25:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:25:50 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:25:50 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:25:52 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:25:52 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:25:53 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:25:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:55 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:25:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:25:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:25:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:25:55 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:25:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:25:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:25:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:25:57 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:25:57 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:25:57 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8397MB free_disk=24.77928924560547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:25:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:25:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:25:58 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:25:58 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:25:58 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:25:58 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 194af77f-525c-4380-bead-6fbf5e1c7f1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:25:58 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 30695565-3d1f-48b8-b85a-19f9e9a28196 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:25:58 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:25:58 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:25:58 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:25:58 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:25:58 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:25:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:25:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:25:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:25:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:25:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:25:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:25:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:25:59 user nova-compute[74278]: INFO nova.compute.manager [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Terminating instance
Oct 30 11:25:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:25:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:25:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-3063055f-a10f-404a-a0c9-2c4e36376e90 req-08eef284-f4b3-4bc9-9830-df079fa6d593 service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-unplugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3063055f-a10f-404a-a0c9-2c4e36376e90 req-08eef284-f4b3-4bc9-9830-df079fa6d593 service nova] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3063055f-a10f-404a-a0c9-2c4e36376e90 req-08eef284-f4b3-4bc9-9830-df079fa6d593 service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-3063055f-a10f-404a-a0c9-2c4e36376e90 req-08eef284-f4b3-4bc9-9830-df079fa6d593 service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-3063055f-a10f-404a-a0c9-2c4e36376e90 req-08eef284-f4b3-4bc9-9830-df079fa6d593 service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] No waiting events found dispatching network-vif-unplugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG nova.compute.manager [req-3063055f-a10f-404a-a0c9-2c4e36376e90 req-08eef284-f4b3-4bc9-9830-df079fa6d593 service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-unplugged-1ae17add-42be-43af-8b80-754d42bf694d for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Instance destroyed successfully.
Oct 30 11:26:00 user nova-compute[74278]: DEBUG nova.objects.instance [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'resources' on Instance uuid 194af77f-525c-4380-bead-6fbf5e1c7f1b {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1731798367',display_name='tempest-TestMinimumBasicScenario-server-1731798367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1731798367',id=47,image_ref='800f0d78-b4c0-4c66-b73f-cb80861926dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxqPXVbuWiMlqYwfdErsmIIeIdNcrv3FqgQHQiihR1KMqooUkXPHLGwgb6OJJ4LmUjJypR/tWEYQurczPvIbbMlbzyUN/UyinQ7hkTZ6KZernIXGRzIY8KVINElc3sYmg==',key_name='tempest-TestMinimumBasicScenario-1479820048',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbe8ef99a57b49049a3266b974ba661b',ramdisk_id='',reservation_id='r-jhg7w6qw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800f0d78-b4c0-4c66-b73f-cb80861926dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-274954723',owner_user_name='tempest-TestMinimumBasicScenario-274954723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:23:14Z,user_data=None,user_id='03fb7307a64e4bcfb24ad4d337e12688',uuid=194af77f-525c-4380-bead-6fbf5e1c7f1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converting VIF {"id": "1ae17add-42be-43af-8b80-754d42bf694d", "address": "fa:16:3e:fb:dc:24", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ae17add-42", "ovs_interfaceid": "1ae17add-42be-43af-8b80-754d42bf694d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG os_vif [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ae17add-42, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1eafaae3-e328-4daa-b125-0b6a0e3650cf) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:00 user nova-compute[74278]: INFO os_vif [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:dc:24,bridge_name='br-int',has_traffic_filtering=True,id=1ae17add-42be-43af-8b80-754d42bf694d,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ae17add-42')
Oct 30 11:26:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Deleting instance files /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b_del
Oct 30 11:26:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Deletion of /opt/stack/data/nova/instances/194af77f-525c-4380-bead-6fbf5e1c7f1b_del complete
Oct 30 11:26:00 user nova-compute[74278]: INFO nova.compute.manager [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 30 11:26:00 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:26:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:01 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:26:01 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Took 0.58 seconds to deallocate network for instance.
Oct 30 11:26:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-7d81ae79-487f-4a9e-a614-315c1baad285 req-5d965c32-2be4-42e5-af79-60b536ca724b service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-deleted-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:01 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:26:01 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:26:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:01 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Deleted allocations for instance 194af77f-525c-4380-bead-6fbf5e1c7f1b
Oct 30 11:26:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-27323ebc-6a3f-4947-8020-49dc8dcc37fe tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.906s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-d5e5fa6d-782f-4033-bc82-8c476f3cd710 req-59d7ad49-eecb-4e0a-8189-0f4f675013c2 service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d5e5fa6d-782f-4033-bc82-8c476f3cd710 req-59d7ad49-eecb-4e0a-8189-0f4f675013c2 service nova] Acquiring lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d5e5fa6d-782f-4033-bc82-8c476f3cd710 req-59d7ad49-eecb-4e0a-8189-0f4f675013c2 service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-d5e5fa6d-782f-4033-bc82-8c476f3cd710 req-59d7ad49-eecb-4e0a-8189-0f4f675013c2 service nova] Lock "194af77f-525c-4380-bead-6fbf5e1c7f1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:02 user nova-compute[74278]: DEBUG nova.compute.manager [req-d5e5fa6d-782f-4033-bc82-8c476f3cd710 req-59d7ad49-eecb-4e0a-8189-0f4f675013c2 service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] No waiting events found dispatching network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:26:02 user nova-compute[74278]: WARNING nova.compute.manager [req-d5e5fa6d-782f-4033-bc82-8c476f3cd710 req-59d7ad49-eecb-4e0a-8189-0f4f675013c2 service nova] [instance: 194af77f-525c-4380-bead-6fbf5e1c7f1b] Received unexpected event network-vif-plugged-1ae17add-42be-43af-8b80-754d42bf694d for instance with vm_state deleted and task_state None.
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:26:03 user nova-compute[74278]: INFO nova.compute.claims [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Claim successful on node user
Oct 30 11:26:03 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG nova.network.neutron [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:26:03 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:26:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:26:03 user nova-compute[74278]: INFO nova.virt.block_device [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Booting with volume 9fa201d4-e1e9-4eb3-85d4-538ba903c542 at /dev/vda
Oct 30 11:26:03 user nova-compute[74278]: DEBUG nova.policy [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e921926b3790497fb9630088c501af82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59235488214e4149a91d6c2d5a02dd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG os_brick.utils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5ab0de-2ed8-448a-9b5d-d252e36c8976]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d225c7-1ded-4da6-8757-6efe645535f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b79e388-ec4b-404e-8030-3d97027ea1e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e888c5c-1a04-4a24-beb1-8a8de6eb8bf8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:26:03 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:26:03 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1cfab7-8bf1-4bfe-ba01-670b52aeb4c8]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG os_brick.utils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:26:03 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Updating existing volume attachment record: c77ba765-d510-48a9-8e4c-2fdb10d2af7a {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:26:05 user nova-compute[74278]: DEBUG nova.network.neutron [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Successfully created port: 133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:26:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:05 user nova-compute[74278]: DEBUG nova.network.neutron [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Successfully updated port: 133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:26:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "refresh_cache-31586a40-57a5-48f7-8b0d-07b58b7f1fb5" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:26:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquired lock "refresh_cache-31586a40-57a5-48f7-8b0d-07b58b7f1fb5" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:26:05 user nova-compute[74278]: DEBUG nova.network.neutron [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:26:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-91fcb805-6890-4cba-9ab4-6f54aa1f7054 req-2f4f2bc4-bda1-432e-92a6-e0ba91c46878 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Received event network-changed-133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:05 user nova-compute[74278]: DEBUG nova.compute.manager [req-91fcb805-6890-4cba-9ab4-6f54aa1f7054 req-2f4f2bc4-bda1-432e-92a6-e0ba91c46878 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Refreshing instance network info cache due to event network-changed-133bb17e-f1b4-4696-b7b8-9c1d2b921efc. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:26:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-91fcb805-6890-4cba-9ab4-6f54aa1f7054 req-2f4f2bc4-bda1-432e-92a6-e0ba91c46878 service nova] Acquiring lock "refresh_cache-31586a40-57a5-48f7-8b0d-07b58b7f1fb5" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:26:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:26:06 user nova-compute[74278]: DEBUG nova.network.neutron [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Updating instance_info_cache with network_info: [{"id": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "address": "fa:16:3e:2f:fc:4e", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bb17e-f1", "ovs_interfaceid": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:26:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Releasing lock "refresh_cache-31586a40-57a5-48f7-8b0d-07b58b7f1fb5" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:26:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Instance network_info: |[{"id": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "address": "fa:16:3e:2f:fc:4e", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bb17e-f1", "ovs_interfaceid": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:26:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-91fcb805-6890-4cba-9ab4-6f54aa1f7054 req-2f4f2bc4-bda1-432e-92a6-e0ba91c46878 service nova] Acquired lock "refresh_cache-31586a40-57a5-48f7-8b0d-07b58b7f1fb5" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:26:06 user nova-compute[74278]: DEBUG nova.network.neutron [req-91fcb805-6890-4cba-9ab4-6f54aa1f7054 req-2f4f2bc4-bda1-432e-92a6-e0ba91c46878 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Refreshing network info cache for port 133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:26:06 user nova-compute[74278]: DEBUG nova.network.neutron [req-91fcb805-6890-4cba-9ab4-6f54aa1f7054 req-2f4f2bc4-bda1-432e-92a6-e0ba91c46878 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Updated VIF entry in instance network info cache for port 133bb17e-f1b4-4696-b7b8-9c1d2b921efc. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:26:06 user nova-compute[74278]: DEBUG nova.network.neutron [req-91fcb805-6890-4cba-9ab4-6f54aa1f7054 req-2f4f2bc4-bda1-432e-92a6-e0ba91c46878 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Updating instance_info_cache with network_info: [{"id": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "address": "fa:16:3e:2f:fc:4e", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bb17e-f1", "ovs_interfaceid": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:26:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-91fcb805-6890-4cba-9ab4-6f54aa1f7054 req-2f4f2bc4-bda1-432e-92a6-e0ba91c46878 service nova] Releasing lock "refresh_cache-31586a40-57a5-48f7-8b0d-07b58b7f1fb5" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:26:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Verify base images {{(pid=74278) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74278) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Image id 4107584d-f654-453b-972a-abcf1c7a0671 yields fingerprint 3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 {{(pid=74278) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 30 11:26:13 user nova-compute[74278]: INFO nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] image 4107584d-f654-453b-972a-abcf1c7a0671 at (/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0): checking
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] image 4107584d-f654-453b-972a-abcf1c7a0671 at (/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0): image is in use {{(pid=74278) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] 30695565-3d1f-48b8-b85a-19f9e9a28196 is a valid instance name {{(pid=74278) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 is a valid instance name {{(pid=74278) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 has a disk file {{(pid=74278) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 is backed by 3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 {{(pid=74278) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 is a valid instance name {{(pid=74278) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 has a disk file {{(pid=74278) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 is backed by 3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 {{(pid=74278) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] 85e83e56-3a30-4c75-b480-b1d298352888 is a valid instance name {{(pid=74278) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] 85e83e56-3a30-4c75-b480-b1d298352888 has a disk file {{(pid=74278) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 30 11:26:13 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:14 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 is backed by 3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 {{(pid=74278) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 30 11:26:14 user nova-compute[74278]: WARNING nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Unknown base file: /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95
Oct 30 11:26:14 user nova-compute[74278]: WARNING nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Unknown base file: /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde
Oct 30 11:26:14 user nova-compute[74278]: WARNING nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Unknown base file: /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116
Oct 30 11:26:14 user nova-compute[74278]: WARNING nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Unknown base file: /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9
Oct 30 11:26:14 user nova-compute[74278]: WARNING nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Unknown base file: /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b
Oct 30 11:26:14 user nova-compute[74278]: WARNING nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Unknown base file: /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315
Oct 30 11:26:14 user nova-compute[74278]: WARNING nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Unknown base file: /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79
Oct 30 11:26:14 user nova-compute[74278]: INFO nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Active base files: /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0
Oct 30 11:26:14 user nova-compute[74278]: INFO nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Removable base files: /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95 /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116 /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9 /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315 /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79
Oct 30 11:26:14 user nova-compute[74278]: INFO nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5dbb91e5cff548f80771b023d1f8113efab93a95
Oct 30 11:26:14 user nova-compute[74278]: INFO nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/03f79da8864d96d35b4d6d69edcc82ff6ee11dde
Oct 30 11:26:14 user nova-compute[74278]: INFO nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/31a2c5ff6d6f5bafb89157e34091cb9d866ac116
Oct 30 11:26:14 user nova-compute[74278]: INFO nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9c3c13ce78154de555b02edbaad5a599101b67d9
Oct 30 11:26:14 user nova-compute[74278]: INFO nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ecdda9506238e76d7f45e8481cda3013042ed65b
Oct 30 11:26:14 user nova-compute[74278]: INFO nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/60c12122be8c107b452ba200720811a80b48a315
Oct 30 11:26:14 user nova-compute[74278]: INFO nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cbf2a305358d2c8be13b8eb7d943e9ab3f459a79
Oct 30 11:26:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Verification complete {{(pid=74278) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 30 11:26:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Verify swap images {{(pid=74278) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 30 11:26:14 user nova-compute[74278]: DEBUG nova.virt.libvirt.imagecache [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Verify ephemeral images {{(pid=74278) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:15 user nova-compute[74278]: INFO nova.compute.manager [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Terminating instance
Oct 30 11:26:15 user nova-compute[74278]: DEBUG nova.compute.manager [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-eea360bc-6f3f-40d4-bc46-692db37eeb4f req-ca72c6bd-8473-4e40-b371-164fe7e144fe service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Received event network-vif-unplugged-145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eea360bc-6f3f-40d4-bc46-692db37eeb4f req-ca72c6bd-8473-4e40-b371-164fe7e144fe service nova] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eea360bc-6f3f-40d4-bc46-692db37eeb4f req-ca72c6bd-8473-4e40-b371-164fe7e144fe service nova] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-eea360bc-6f3f-40d4-bc46-692db37eeb4f req-ca72c6bd-8473-4e40-b371-164fe7e144fe service nova] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-eea360bc-6f3f-40d4-bc46-692db37eeb4f req-ca72c6bd-8473-4e40-b371-164fe7e144fe service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] No waiting events found dispatching network-vif-unplugged-145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:26:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-eea360bc-6f3f-40d4-bc46-692db37eeb4f req-ca72c6bd-8473-4e40-b371-164fe7e144fe service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Received event network-vif-unplugged-145199b0-d3de-4607-949f-16e697b9b1db for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:26:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Instance destroyed successfully.
Oct 30 11:26:16 user nova-compute[74278]: DEBUG nova.objects.instance [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lazy-loading 'resources' on Instance uuid 4338fbe0-d9f1-4425-a2fc-72c78d4bce34 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1725281181',display_name='tempest-SnapshotDataIntegrityTests-server-1725281181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1725281181',id=44,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9Byoa08RcTocpOCS7eBZw0ROb3iNzcjSsXh1RNbfUv0xUPRfDGzKDJIOEG24i/6NMIQAirPudo/Jve9BevNDyHDt4iwT0XM0zo/clZL1twY6ugVROhIOZhddl9EPUrMQ==',key_name='tempest-keypair-654091655',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:17:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a18ced034d3e435c9c8b0062a18b01e5',ramdisk_id='',reservation_id='r-mucb8x39',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-21329946',owner_user_name='tempest-SnapshotDataIntegrityTests-21329946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:17:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='83ae50730c1043e4bd50a078f50d9a4a',uuid=4338fbe0-d9f1-4425-a2fc-72c78d4bce34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Converting VIF {"id": "145199b0-d3de-4607-949f-16e697b9b1db", "address": "fa:16:3e:91:ad:9d", "network": {"id": "a7fa42d1-654d-4864-9899-ae773e50243b", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-650647229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18ced034d3e435c9c8b0062a18b01e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145199b0-d3", "ovs_interfaceid": "145199b0-d3de-4607-949f-16e697b9b1db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:ad:9d,bridge_name='br-int',has_traffic_filtering=True,id=145199b0-d3de-4607-949f-16e697b9b1db,network=Network(a7fa42d1-654d-4864-9899-ae773e50243b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145199b0-d3') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG os_vif [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:ad:9d,bridge_name='br-int',has_traffic_filtering=True,id=145199b0-d3de-4607-949f-16e697b9b1db,network=Network(a7fa42d1-654d-4864-9899-ae773e50243b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145199b0-d3') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap145199b0-d3, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1dd814e9-5623-4f4c-a6e4-bf79b1283ae6) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:26:16 user nova-compute[74278]: INFO os_vif [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:ad:9d,bridge_name='br-int',has_traffic_filtering=True,id=145199b0-d3de-4607-949f-16e697b9b1db,network=Network(a7fa42d1-654d-4864-9899-ae773e50243b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145199b0-d3')
Oct 30 11:26:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Deleting instance files /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34_del
Oct 30 11:26:16 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Deletion of /opt/stack/data/nova/instances/4338fbe0-d9f1-4425-a2fc-72c78d4bce34_del complete
Oct 30 11:26:16 user nova-compute[74278]: INFO nova.compute.manager [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 30 11:26:16 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:26:16 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:26:17 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:26:17 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Took 0.88 seconds to deallocate network for instance.
Oct 30 11:26:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-d1d25ac6-817f-4fff-8d02-006da2732ead req-3ad9fce3-76da-4ea4-b8c9-1bb74627b6b4 service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Received event network-vif-deleted-145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:17 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:26:17 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:26:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:17 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Deleted allocations for instance 4338fbe0-d9f1-4425-a2fc-72c78d4bce34
Oct 30 11:26:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-6955a817-33bf-43c5-9504-5bca1faf4591 tempest-SnapshotDataIntegrityTests-21329946 tempest-SnapshotDataIntegrityTests-21329946-project-member] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.154s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-66eb376f-e662-4dcd-9789-90dea0fc655a req-1b2635d0-bd45-4f36-8f75-cb31a17564ce service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Received event network-vif-plugged-145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-66eb376f-e662-4dcd-9789-90dea0fc655a req-1b2635d0-bd45-4f36-8f75-cb31a17564ce service nova] Acquiring lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-66eb376f-e662-4dcd-9789-90dea0fc655a req-1b2635d0-bd45-4f36-8f75-cb31a17564ce service nova] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-66eb376f-e662-4dcd-9789-90dea0fc655a req-1b2635d0-bd45-4f36-8f75-cb31a17564ce service nova] Lock "4338fbe0-d9f1-4425-a2fc-72c78d4bce34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-66eb376f-e662-4dcd-9789-90dea0fc655a req-1b2635d0-bd45-4f36-8f75-cb31a17564ce service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] No waiting events found dispatching network-vif-plugged-145199b0-d3de-4607-949f-16e697b9b1db {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:26:17 user nova-compute[74278]: WARNING nova.compute.manager [req-66eb376f-e662-4dcd-9789-90dea0fc655a req-1b2635d0-bd45-4f36-8f75-cb31a17564ce service nova] [instance: 4338fbe0-d9f1-4425-a2fc-72c78d4bce34] Received unexpected event network-vif-plugged-145199b0-d3de-4607-949f-16e697b9b1db for instance with vm_state deleted and task_state None.
Oct 30 11:26:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:26:23 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Creating image(s)
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Did not create local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Ensure instance console log exists: /opt/stack/data/nova/instances/31586a40-57a5-48f7-8b0d-07b58b7f1fb5/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Start _get_guest_xml network_info=[{"id": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "address": "fa:16:3e:2f:fc:4e", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bb17e-f1", "ovs_interfaceid": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKFWCkQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '31586a40-57a5-48f7-8b0d-07b58b7f1fb5', 'attached_at': '', 'detached_at': '', 'volume_id': '9fa201d4-e1e9-4eb3-85d4-538ba903c542', 'serial': '9fa201d4-e1e9-4eb3-85d4-538ba903c542'}, 'attachment_id': 'c77ba765-d510-48a9-8e4c-2fdb10d2af7a', 'volume_type': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:26:23 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:26:23 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKFWCkQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:26:23 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:26:23 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:26:23 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ee61bc-9e3c-4872-b9d1-f3e327e675e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:26:23 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a29d54-7eb0-4d64-b42b-9da6291de3dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542] added
Oct 30 11:26:23 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c06f09-c08c-4268-bbec-4c1af7c6c9eb]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[2917a4b8-a87e-49d9-9ac1-d1927dca66f7]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKFWCkQz {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UKFWCkQz" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a229e5ac-d744-4c9a-abff-1e97ae278fa1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UKFWCkQz'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[919f6280-cffa-481b-8773-669e2d78bb6e]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6140da8-14d0-47b8-a3d5-7237f73a236e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:26:23 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:26:23 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[941d6f35-878e-4cf3-80be-8665becd373d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542, portal: 172.16.0.220,3260]
Oct 30 11:26:23 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542, portal: 172.16.0.220,3260] successful.
Oct 30 11:26:23 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[249a253c-f888-49ec-8374-0895654c60c7]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e7b1e5-ecea-4f54-8fc2-4c50d3ce1400]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:26:23 user nova-compute[74278]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 (non-flash)
Oct 30 11:26:23 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:26:23 user nova-compute[74278]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 (non-flash)
Oct 30 11:26:23 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b48032-c56d-4768-a5cc-810708ea8b33]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:26:23 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKFWCkQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23337623466663939', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337623466663939', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-864542468',display_name='tempest-TestVolumeBootPattern-server-864542468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-864542468',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwVoOsdyxK0SNJwN4HZdm83195LyA9Z0y2NGjM0FwHB0Pi1YZz1ojqsLwPsv+2VzYnIe6fA5rtOwUJoMGSzNFwd6qP/wjrkBI6PJWy0NWF/x6FOi1/pKN50JcP0R1EE6Q==',key_name='tempest-TestVolumeBootPattern-1784921068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-az999nzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:26:04Z,user_data=None,user_id='e921926b3790497fb9630088c501af82',uuid=31586a40-57a5-48f7-8b0d-07b58b7f1fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "address": "fa:16:3e:2f:fc:4e", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bb17e-f1", "ovs_interfaceid": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "address": "fa:16:3e:2f:fc:4e", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bb17e-f1", "ovs_interfaceid": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:fc:4e,bridge_name='br-int',has_traffic_filtering=True,id=133bb17e-f1b4-4696-b7b8-9c1d2b921efc,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bb17e-f1') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG nova.objects.instance [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lazy-loading 'pci_devices' on Instance uuid 31586a40-57a5-48f7-8b0d-07b58b7f1fb5 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:26:24 user nova-compute[74278]:   <uuid>31586a40-57a5-48f7-8b0d-07b58b7f1fb5</uuid>
Oct 30 11:26:24 user nova-compute[74278]:   <name>instance-00000032</name>
Oct 30 11:26:24 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:26:24 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:26:24 user nova-compute[74278]:   <metadata>
Oct 30 11:26:24 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:26:24 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:26:24 user nova-compute[74278]:       <nova:name>tempest-TestVolumeBootPattern-server-864542468</nova:name>
Oct 30 11:26:24 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:26:23</nova:creationTime>
Oct 30 11:26:24 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:26:24 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:26:24 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:26:24 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:26:24 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:26:24 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:26:24 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:26:24 user nova-compute[74278]:       <nova:owner>
Oct 30 11:26:24 user nova-compute[74278]:         <nova:user uuid="e921926b3790497fb9630088c501af82">tempest-TestVolumeBootPattern-2008975673-project-member</nova:user>
Oct 30 11:26:24 user nova-compute[74278]:         <nova:project uuid="59235488214e4149a91d6c2d5a02dd21">tempest-TestVolumeBootPattern-2008975673</nova:project>
Oct 30 11:26:24 user nova-compute[74278]:       </nova:owner>
Oct 30 11:26:24 user nova-compute[74278]:       <nova:ports>
Oct 30 11:26:24 user nova-compute[74278]:         <nova:port uuid="133bb17e-f1b4-4696-b7b8-9c1d2b921efc">
Oct 30 11:26:24 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 11:26:24 user nova-compute[74278]:         </nova:port>
Oct 30 11:26:24 user nova-compute[74278]:       </nova:ports>
Oct 30 11:26:24 user nova-compute[74278]:     </nova:instance>
Oct 30 11:26:24 user nova-compute[74278]:   </metadata>
Oct 30 11:26:24 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:26:24 user nova-compute[74278]:     <system>
Oct 30 11:26:24 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:26:24 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:26:24 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:26:24 user nova-compute[74278]:       <entry name="serial">31586a40-57a5-48f7-8b0d-07b58b7f1fb5</entry>
Oct 30 11:26:24 user nova-compute[74278]:       <entry name="uuid">31586a40-57a5-48f7-8b0d-07b58b7f1fb5</entry>
Oct 30 11:26:24 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:26:24 user nova-compute[74278]:     </system>
Oct 30 11:26:24 user nova-compute[74278]:   </sysinfo>
Oct 30 11:26:24 user nova-compute[74278]:   <os>
Oct 30 11:26:24 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:26:24 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:26:24 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:26:24 user nova-compute[74278]:   </os>
Oct 30 11:26:24 user nova-compute[74278]:   <features>
Oct 30 11:26:24 user nova-compute[74278]:     <acpi/>
Oct 30 11:26:24 user nova-compute[74278]:     <apic/>
Oct 30 11:26:24 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:26:24 user nova-compute[74278]:   </features>
Oct 30 11:26:24 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:26:24 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:26:24 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:26:24 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:26:24 user nova-compute[74278]:   </clock>
Oct 30 11:26:24 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:26:24 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:26:24 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:26:24 user nova-compute[74278]:   </cpu>
Oct 30 11:26:24 user nova-compute[74278]:   <devices>
Oct 30 11:26:24 user nova-compute[74278]:     <disk type="block" device="disk">
Oct 30 11:26:24 user nova-compute[74278]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:26:24 user nova-compute[74278]:       <source dev="/dev/sdb"/>
Oct 30 11:26:24 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:26:24 user nova-compute[74278]:       <serial>9fa201d4-e1e9-4eb3-85d4-538ba903c542</serial>
Oct 30 11:26:24 user nova-compute[74278]:     </disk>
Oct 30 11:26:24 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:26:24 user nova-compute[74278]:       <mac address="fa:16:3e:2f:fc:4e"/>
Oct 30 11:26:24 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:26:24 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:26:24 user nova-compute[74278]:       <target dev="tap133bb17e-f1"/>
Oct 30 11:26:24 user nova-compute[74278]:     </interface>
Oct 30 11:26:24 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:26:24 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/31586a40-57a5-48f7-8b0d-07b58b7f1fb5/console.log" append="off"/>
Oct 30 11:26:24 user nova-compute[74278]:     </serial>
Oct 30 11:26:24 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:26:24 user nova-compute[74278]:     <video>
Oct 30 11:26:24 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:26:24 user nova-compute[74278]:     </video>
Oct 30 11:26:24 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:26:24 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:26:24 user nova-compute[74278]:     </rng>
Oct 30 11:26:24 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:26:24 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:26:24 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:26:24 user nova-compute[74278]:     </memballoon>
Oct 30 11:26:24 user nova-compute[74278]:   </devices>
Oct 30 11:26:24 user nova-compute[74278]: </domain>
Oct 30 11:26:24 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-864542468',display_name='tempest-TestVolumeBootPattern-server-864542468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-864542468',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwVoOsdyxK0SNJwN4HZdm83195LyA9Z0y2NGjM0FwHB0Pi1YZz1ojqsLwPsv+2VzYnIe6fA5rtOwUJoMGSzNFwd6qP/wjrkBI6PJWy0NWF/x6FOi1/pKN50JcP0R1EE6Q==',key_name='tempest-TestVolumeBootPattern-1784921068',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-az999nzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:26:04Z,user_data=None,user_id='e921926b3790497fb9630088c501af82',uuid=31586a40-57a5-48f7-8b0d-07b58b7f1fb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "address": "fa:16:3e:2f:fc:4e", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bb17e-f1", "ovs_interfaceid": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "address": "fa:16:3e:2f:fc:4e", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bb17e-f1", "ovs_interfaceid": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:fc:4e,bridge_name='br-int',has_traffic_filtering=True,id=133bb17e-f1b4-4696-b7b8-9c1d2b921efc,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bb17e-f1') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG os_vif [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:fc:4e,bridge_name='br-int',has_traffic_filtering=True,id=133bb17e-f1b4-4696-b7b8-9c1d2b921efc,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bb17e-f1') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ec9f2e3-a417-5551-af91-7c5788c8cab6', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap133bb17e-f1, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap133bb17e-f1, col_values=(('qos', UUID('8c3512d4-88c0-4d47-ad5a-1362df3bc4f1')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap133bb17e-f1, col_values=(('external_ids', {'iface-id': '133bb17e-f1b4-4696-b7b8-9c1d2b921efc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:fc:4e', 'vm-uuid': '31586a40-57a5-48f7-8b0d-07b58b7f1fb5'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:24 user nova-compute[74278]: INFO os_vif [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:fc:4e,bridge_name='br-int',has_traffic_filtering=True,id=133bb17e-f1b4-4696-b7b8-9c1d2b921efc,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bb17e-f1')
Oct 30 11:26:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:26:24 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] No VIF found with MAC fa:16:3e:2f:fc:4e, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:26:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-0aebab83-79b8-4114-9675-0d282f4b880c req-dceffa0c-64d3-4b93-8d43-4b7b347690b5 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Received event network-vif-plugged-133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0aebab83-79b8-4114-9675-0d282f4b880c req-dceffa0c-64d3-4b93-8d43-4b7b347690b5 service nova] Acquiring lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0aebab83-79b8-4114-9675-0d282f4b880c req-dceffa0c-64d3-4b93-8d43-4b7b347690b5 service nova] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:26 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0aebab83-79b8-4114-9675-0d282f4b880c req-dceffa0c-64d3-4b93-8d43-4b7b347690b5 service nova] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:26 user nova-compute[74278]: DEBUG nova.compute.manager [req-0aebab83-79b8-4114-9675-0d282f4b880c req-dceffa0c-64d3-4b93-8d43-4b7b347690b5 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] No waiting events found dispatching network-vif-plugged-133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:26:26 user nova-compute[74278]: WARNING nova.compute.manager [req-0aebab83-79b8-4114-9675-0d282f4b880c req-dceffa0c-64d3-4b93-8d43-4b7b347690b5 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Received unexpected event network-vif-plugged-133bb17e-f1b4-4696-b7b8-9c1d2b921efc for instance with vm_state building and task_state spawning.
Oct 30 11:26:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG nova.compute.manager [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:26:28 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Instance spawned successfully.
Oct 30 11:26:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:26:28 user nova-compute[74278]: INFO nova.compute.manager [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Took 4.88 seconds to spawn the instance on the hypervisor.
Oct 30 11:26:28 user nova-compute[74278]: DEBUG nova.compute.manager [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:26:28 user nova-compute[74278]: INFO nova.compute.manager [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Took 25.06 seconds to build instance.
Oct 30 11:26:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-41838b45-98a9-4fe0-8b4a-2254d4eb5fb2 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.159s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-c2268741-7b4d-4346-91e0-0250ca2b3cb8 req-1dd9738c-a94a-441f-9a82-45e55ad2dbf7 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Received event network-vif-plugged-133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c2268741-7b4d-4346-91e0-0250ca2b3cb8 req-1dd9738c-a94a-441f-9a82-45e55ad2dbf7 service nova] Acquiring lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c2268741-7b4d-4346-91e0-0250ca2b3cb8 req-1dd9738c-a94a-441f-9a82-45e55ad2dbf7 service nova] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c2268741-7b4d-4346-91e0-0250ca2b3cb8 req-1dd9738c-a94a-441f-9a82-45e55ad2dbf7 service nova] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:28 user nova-compute[74278]: DEBUG nova.compute.manager [req-c2268741-7b4d-4346-91e0-0250ca2b3cb8 req-1dd9738c-a94a-441f-9a82-45e55ad2dbf7 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] No waiting events found dispatching network-vif-plugged-133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:26:28 user nova-compute[74278]: WARNING nova.compute.manager [req-c2268741-7b4d-4346-91e0-0250ca2b3cb8 req-1dd9738c-a94a-441f-9a82-45e55ad2dbf7 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Received unexpected event network-vif-plugged-133bb17e-f1b4-4696-b7b8-9c1d2b921efc for instance with vm_state active and task_state None.
Oct 30 11:26:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:26:43 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:26:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:26:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:26:49 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:26:49 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:26:49 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:26:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:51 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:26:51 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:26:51 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Didn't find any instances for network info cache update. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 11:26:51 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:26:52 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:26:52 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:26:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:52 user nova-compute[74278]: DEBUG nova.compute.manager [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:26:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:52 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:26:52 user nova-compute[74278]: INFO nova.compute.claims [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Claim successful on node user
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Refreshing inventories for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Updating ProviderTree inventory for provider ce405684-67ab-45d9-bc83-6af4903bfb15 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Updating inventory in ProviderTree for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Refreshing aggregate associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, aggregates: None {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Refreshing trait associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.network.neutron [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:26:53 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.policy [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ad932a451724349a5c40964d7e75157', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a881207e0d4a4314a979e3af56cf2f95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:26:53 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Creating image(s)
Oct 30 11:26:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "/opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "/opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.186s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Starting instance... {{(pid=74278) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.203s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk 1073741824" returned: 0 in 0.050s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74278) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 11:26:54 user nova-compute[74278]: INFO nova.compute.claims [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Claim successful on node user
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Successfully created port: bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Cannot resize image /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Ensure instance console log exists: /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Start building networks asynchronously for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Allocating IP information in the background. {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] allocate_for_instance() {{(pid=74278) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 11:26:54 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Start building block device mappings for instance. {{(pid=74278) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.policy [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03fb7307a64e4bcfb24ad4d337e12688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe8ef99a57b49049a3266b974ba661b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74278) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Start spawning the instance on the hypervisor. {{(pid=74278) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Creating instance directory {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 11:26:54 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Creating image(s)
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "/opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "/opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "a811cd133a25ae646774add29a8a8cfd6d1bef42" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a811cd133a25ae646774add29a8a8cfd6d1bef42" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Successfully updated port: bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquired lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-4fbfca68-cd4a-49a8-b20b-30cba3166369 req-a6e19f3c-2eac-4c53-9de8-8f005a4bf71b service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-changed-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-4fbfca68-cd4a-49a8-b20b-30cba3166369 req-a6e19f3c-2eac-4c53-9de8-8f005a4bf71b service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Refreshing instance network info cache due to event network-changed-bee51f46-936e-44f3-bc9d-60bc94025b37. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:26:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4fbfca68-cd4a-49a8-b20b-30cba3166369 req-a6e19f3c-2eac-4c53-9de8-8f005a4bf71b service nova] Acquiring lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42.part --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.network.neutron [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42.part --force-share --output=json" returned: 0 in 0.169s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.images [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] 1b0d2fb4-d151-4d7d-b7da-cb55d40aa847 was qcow2, converting to raw {{(pid=74278) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.privsep.utils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74278) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42.part /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42.converted {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Successfully created port: 55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.network.neutron [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updating instance_info_cache with network_info: [{"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Releasing lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.compute.manager [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Instance network_info: |[{"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4fbfca68-cd4a-49a8-b20b-30cba3166369 req-a6e19f3c-2eac-4c53-9de8-8f005a4bf71b service nova] Acquired lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-4fbfca68-cd4a-49a8-b20b-30cba3166369 req-a6e19f3c-2eac-4c53-9de8-8f005a4bf71b service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Refreshing network info cache for port bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Start _get_guest_xml network_info=[{"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '4107584d-f654-453b-972a-abcf1c7a0671'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42.part /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42.converted" returned: 0 in 0.360s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42.converted --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:55 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:26:55 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-511782841',display_name='tempest-ServerRescueNegativeTestJSON-server-511782841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-511782841',id=51,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAqL4y+XnS+gly0VAbSOSvcpyqUTX/mfD36u6nFufbYk5xGRXwyztWf2UqC7vTAFoG2vnZLg/CBBePeDiB60SF9Mz+V2MwUf8wzawoByo6mCN97zQ65zjHEq5uT1I/19A==',key_name='tempest-keypair-1125188050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a881207e0d4a4314a979e3af56cf2f95',ramdisk_id='',reservation_id='r-3id3wdaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2065673492',owner_user_name='tempest-ServerRescueNegativeTestJSON-2065673492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:26:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad932a451724349a5c40964d7e75157',uuid=0a11cbf9-03bd-4f17-9fc8-41e095780fe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converting VIF {"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:b4:2e,bridge_name='br-int',has_traffic_filtering=True,id=bee51f46-936e-44f3-bc9d-60bc94025b37,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee51f46-93') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.objects.instance [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:26:55 user nova-compute[74278]:   <uuid>0a11cbf9-03bd-4f17-9fc8-41e095780fe9</uuid>
Oct 30 11:26:55 user nova-compute[74278]:   <name>instance-00000033</name>
Oct 30 11:26:55 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:26:55 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:26:55 user nova-compute[74278]:   <metadata>
Oct 30 11:26:55 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:26:55 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:26:55 user nova-compute[74278]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-511782841</nova:name>
Oct 30 11:26:55 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:26:55</nova:creationTime>
Oct 30 11:26:55 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:26:55 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:26:55 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:26:55 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:26:55 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:26:55 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:26:55 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:26:55 user nova-compute[74278]:       <nova:owner>
Oct 30 11:26:55 user nova-compute[74278]:         <nova:user uuid="8ad932a451724349a5c40964d7e75157">tempest-ServerRescueNegativeTestJSON-2065673492-project-member</nova:user>
Oct 30 11:26:55 user nova-compute[74278]:         <nova:project uuid="a881207e0d4a4314a979e3af56cf2f95">tempest-ServerRescueNegativeTestJSON-2065673492</nova:project>
Oct 30 11:26:55 user nova-compute[74278]:       </nova:owner>
Oct 30 11:26:55 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:26:55 user nova-compute[74278]:       <nova:ports>
Oct 30 11:26:55 user nova-compute[74278]:         <nova:port uuid="bee51f46-936e-44f3-bc9d-60bc94025b37">
Oct 30 11:26:55 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 11:26:55 user nova-compute[74278]:         </nova:port>
Oct 30 11:26:55 user nova-compute[74278]:       </nova:ports>
Oct 30 11:26:55 user nova-compute[74278]:     </nova:instance>
Oct 30 11:26:55 user nova-compute[74278]:   </metadata>
Oct 30 11:26:55 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:26:55 user nova-compute[74278]:     <system>
Oct 30 11:26:55 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:26:55 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:26:55 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:26:55 user nova-compute[74278]:       <entry name="serial">0a11cbf9-03bd-4f17-9fc8-41e095780fe9</entry>
Oct 30 11:26:55 user nova-compute[74278]:       <entry name="uuid">0a11cbf9-03bd-4f17-9fc8-41e095780fe9</entry>
Oct 30 11:26:55 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:26:55 user nova-compute[74278]:     </system>
Oct 30 11:26:55 user nova-compute[74278]:   </sysinfo>
Oct 30 11:26:55 user nova-compute[74278]:   <os>
Oct 30 11:26:55 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:26:55 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:26:55 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:26:55 user nova-compute[74278]:   </os>
Oct 30 11:26:55 user nova-compute[74278]:   <features>
Oct 30 11:26:55 user nova-compute[74278]:     <acpi/>
Oct 30 11:26:55 user nova-compute[74278]:     <apic/>
Oct 30 11:26:55 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:26:55 user nova-compute[74278]:   </features>
Oct 30 11:26:55 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:26:55 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:26:55 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:26:55 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:26:55 user nova-compute[74278]:   </clock>
Oct 30 11:26:55 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:26:55 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:26:55 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:26:55 user nova-compute[74278]:   </cpu>
Oct 30 11:26:55 user nova-compute[74278]:   <devices>
Oct 30 11:26:55 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:26:55 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:26:55 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk"/>
Oct 30 11:26:55 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:26:55 user nova-compute[74278]:     </disk>
Oct 30 11:26:55 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:26:55 user nova-compute[74278]:       <mac address="fa:16:3e:fa:b4:2e"/>
Oct 30 11:26:55 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:26:55 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:26:55 user nova-compute[74278]:       <target dev="tapbee51f46-93"/>
Oct 30 11:26:55 user nova-compute[74278]:     </interface>
Oct 30 11:26:55 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:26:55 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/console.log" append="off"/>
Oct 30 11:26:55 user nova-compute[74278]:     </serial>
Oct 30 11:26:55 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:26:55 user nova-compute[74278]:     <video>
Oct 30 11:26:55 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:26:55 user nova-compute[74278]:     </video>
Oct 30 11:26:55 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:26:55 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:26:55 user nova-compute[74278]:     </rng>
Oct 30 11:26:55 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:26:55 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:26:55 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:26:55 user nova-compute[74278]:     </memballoon>
Oct 30 11:26:55 user nova-compute[74278]:   </devices>
Oct 30 11:26:55 user nova-compute[74278]: </domain>
Oct 30 11:26:55 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-511782841',display_name='tempest-ServerRescueNegativeTestJSON-server-511782841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-511782841',id=51,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAqL4y+XnS+gly0VAbSOSvcpyqUTX/mfD36u6nFufbYk5xGRXwyztWf2UqC7vTAFoG2vnZLg/CBBePeDiB60SF9Mz+V2MwUf8wzawoByo6mCN97zQ65zjHEq5uT1I/19A==',key_name='tempest-keypair-1125188050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a881207e0d4a4314a979e3af56cf2f95',ramdisk_id='',reservation_id='r-3id3wdaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2065673492',owner_user_name='tempest-ServerRescueNegativeTestJSON-2065673492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:26:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad932a451724349a5c40964d7e75157',uuid=0a11cbf9-03bd-4f17-9fc8-41e095780fe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converting VIF {"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:b4:2e,bridge_name='br-int',has_traffic_filtering=True,id=bee51f46-936e-44f3-bc9d-60bc94025b37,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee51f46-93') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG os_vif [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:b4:2e,bridge_name='br-int',has_traffic_filtering=True,id=bee51f46-936e-44f3-bc9d-60bc94025b37,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee51f46-93') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '440bb061-4d6f-5fe6-a926-4f53fbae66f1', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbee51f46-93, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbee51f46-93, col_values=(('qos', UUID('d02ad26f-9478-45e1-a723-eb222d40bbd7')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbee51f46-93, col_values=(('external_ids', {'iface-id': 'bee51f46-936e-44f3-bc9d-60bc94025b37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:b4:2e', 'vm-uuid': '0a11cbf9-03bd-4f17-9fc8-41e095780fe9'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:55 user nova-compute[74278]: INFO os_vif [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:b4:2e,bridge_name='br-int',has_traffic_filtering=True,id=bee51f46-936e-44f3-bc9d-60bc94025b37,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee51f46-93')
Oct 30 11:26:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a811cd133a25ae646774add29a8a8cfd6d1bef42" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.191s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:55 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No VIF found with MAC fa:16:3e:fa:b4:2e, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42 --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "a811cd133a25ae646774add29a8a8cfd6d1bef42" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a811cd133a25ae646774add29a8a8cfd6d1bef42" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Successfully updated port: 55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquired lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-4fbfca68-cd4a-49a8-b20b-30cba3166369 req-a6e19f3c-2eac-4c53-9de8-8f005a4bf71b service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updated VIF entry in instance network info cache for port bee51f46-936e-44f3-bc9d-60bc94025b37. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-4fbfca68-cd4a-49a8-b20b-30cba3166369 req-a6e19f3c-2eac-4c53-9de8-8f005a4bf71b service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updating instance_info_cache with network_info: [{"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-81cb593d-49f4-4b0b-9911-bcc623c25c3e req-c16b9e44-77f5-4602-b89f-679f6f519094 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-changed-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-81cb593d-49f4-4b0b-9911-bcc623c25c3e req-c16b9e44-77f5-4602-b89f-679f6f519094 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Refreshing instance network info cache due to event network-changed-55a7d605-3793-4ff7-b0f7-6b375df45cf5. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-81cb593d-49f4-4b0b-9911-bcc623c25c3e req-c16b9e44-77f5-4602-b89f-679f6f519094 service nova] Acquiring lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-4fbfca68-cd4a-49a8-b20b-30cba3166369 req-a6e19f3c-2eac-4c53-9de8-8f005a4bf71b service nova] Releasing lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Instance cache missing network info. {{(pid=74278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42 --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42,backing_fmt=raw /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk 1073741824 {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42,backing_fmt=raw /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk 1073741824" returned: 0 in 0.051s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a811cd133a25ae646774add29a8a8cfd6d1bef42" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74278) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a811cd133a25ae646774add29a8a8cfd6d1bef42 --force-share --output=json" returned: 0 in 0.171s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk. size=1073741824 {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.network.neutron [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Updating instance_info_cache with network_info: [{"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Releasing lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Instance network_info: |[{"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74278) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-81cb593d-49f4-4b0b-9911-bcc623c25c3e req-c16b9e44-77f5-4602-b89f-679f6f519094 service nova] Acquired lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.network.neutron [req-81cb593d-49f4-4b0b-9911-bcc623c25c3e req-c16b9e44-77f5-4602-b89f-679f6f519094 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Refreshing network info cache for port 55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.disk.api [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Cannot resize image /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk to a smaller size. {{(pid=74278) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Ensure instance console log exists: /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/console.log {{(pid=74278) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Start _get_guest_xml network_info=[{"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T11:26:51Z,direct_url=<?>,disk_format='qcow2',id=1b0d2fb4-d151-4d7d-b7da-cb55d40aa847,min_disk=0,min_ram=0,name='tempest-scenario-img--2029852881',owner='dbe8ef99a57b49049a3266b974ba661b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T11:26:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_options': None, 'encrypted': False, 'image_id': '1b0d2fb4-d151-4d7d-b7da-cb55d40aa847'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:26:56 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:26:56 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T11:26:51Z,direct_url=<?>,disk_format='qcow2',id=1b0d2fb4-d151-4d7d-b7da-cb55d40aa847,min_disk=0,min_ram=0,name='tempest-scenario-img--2029852881',owner='dbe8ef99a57b49049a3266b974ba661b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T11:26:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1497588327',display_name='tempest-TestMinimumBasicScenario-server-1497588327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1497588327',id=52,image_ref='1b0d2fb4-d151-4d7d-b7da-cb55d40aa847',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7j5x50HthJ4tyoc7JJ3s7oGpnBbgA5knRQGb36CewRyC6qEpxEtQkac22R1UbVt+x+6z70ZZkW2kiCarFPYBwrFhE6uXWI6Z9Bkx04DVvfYxEsNbFsSLJqYorY7JI6Og==',key_name='tempest-TestMinimumBasicScenario-1392120610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbe8ef99a57b49049a3266b974ba661b',ramdisk_id='',reservation_id='r-tn6iiyhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1b0d2fb4-d151-4d7d-b7da-cb55d40aa847',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-274954723',owner_user_name='tempest-TestMinimumBasicScenario-274954723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:26:55Z,user_data=None,user_id='03fb7307a64e4bcfb24ad4d337e12688',uuid=a3fca38e-c502-4111-8373-46491d806183,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converting VIF {"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:ae:c5,bridge_name='br-int',has_traffic_filtering=True,id=55a7d605-3793-4ff7-b0f7-6b375df45cf5,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a7d605-37') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.objects.instance [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'pci_devices' on Instance uuid a3fca38e-c502-4111-8373-46491d806183 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:26:56 user nova-compute[74278]:   <uuid>a3fca38e-c502-4111-8373-46491d806183</uuid>
Oct 30 11:26:56 user nova-compute[74278]:   <name>instance-00000034</name>
Oct 30 11:26:56 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:26:56 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:26:56 user nova-compute[74278]:   <metadata>
Oct 30 11:26:56 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:26:56 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:26:56 user nova-compute[74278]:       <nova:name>tempest-TestMinimumBasicScenario-server-1497588327</nova:name>
Oct 30 11:26:56 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:26:56</nova:creationTime>
Oct 30 11:26:56 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:26:56 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:26:56 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:26:56 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:26:56 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:26:56 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:26:56 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:26:56 user nova-compute[74278]:       <nova:owner>
Oct 30 11:26:56 user nova-compute[74278]:         <nova:user uuid="03fb7307a64e4bcfb24ad4d337e12688">tempest-TestMinimumBasicScenario-274954723-project-member</nova:user>
Oct 30 11:26:56 user nova-compute[74278]:         <nova:project uuid="dbe8ef99a57b49049a3266b974ba661b">tempest-TestMinimumBasicScenario-274954723</nova:project>
Oct 30 11:26:56 user nova-compute[74278]:       </nova:owner>
Oct 30 11:26:56 user nova-compute[74278]:       <nova:root type="image" uuid="1b0d2fb4-d151-4d7d-b7da-cb55d40aa847"/>
Oct 30 11:26:56 user nova-compute[74278]:       <nova:ports>
Oct 30 11:26:56 user nova-compute[74278]:         <nova:port uuid="55a7d605-3793-4ff7-b0f7-6b375df45cf5">
Oct 30 11:26:56 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 11:26:56 user nova-compute[74278]:         </nova:port>
Oct 30 11:26:56 user nova-compute[74278]:       </nova:ports>
Oct 30 11:26:56 user nova-compute[74278]:     </nova:instance>
Oct 30 11:26:56 user nova-compute[74278]:   </metadata>
Oct 30 11:26:56 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:26:56 user nova-compute[74278]:     <system>
Oct 30 11:26:56 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:26:56 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:26:56 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:26:56 user nova-compute[74278]:       <entry name="serial">a3fca38e-c502-4111-8373-46491d806183</entry>
Oct 30 11:26:56 user nova-compute[74278]:       <entry name="uuid">a3fca38e-c502-4111-8373-46491d806183</entry>
Oct 30 11:26:56 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:26:56 user nova-compute[74278]:     </system>
Oct 30 11:26:56 user nova-compute[74278]:   </sysinfo>
Oct 30 11:26:56 user nova-compute[74278]:   <os>
Oct 30 11:26:56 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:26:56 user nova-compute[74278]:     <boot dev="hd"/>
Oct 30 11:26:56 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:26:56 user nova-compute[74278]:   </os>
Oct 30 11:26:56 user nova-compute[74278]:   <features>
Oct 30 11:26:56 user nova-compute[74278]:     <acpi/>
Oct 30 11:26:56 user nova-compute[74278]:     <apic/>
Oct 30 11:26:56 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:26:56 user nova-compute[74278]:   </features>
Oct 30 11:26:56 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:26:56 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:26:56 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:26:56 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:26:56 user nova-compute[74278]:   </clock>
Oct 30 11:26:56 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:26:56 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:26:56 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:26:56 user nova-compute[74278]:   </cpu>
Oct 30 11:26:56 user nova-compute[74278]:   <devices>
Oct 30 11:26:56 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:26:56 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:26:56 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk"/>
Oct 30 11:26:56 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:26:56 user nova-compute[74278]:     </disk>
Oct 30 11:26:56 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:26:56 user nova-compute[74278]:       <mac address="fa:16:3e:99:ae:c5"/>
Oct 30 11:26:56 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:26:56 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:26:56 user nova-compute[74278]:       <target dev="tap55a7d605-37"/>
Oct 30 11:26:56 user nova-compute[74278]:     </interface>
Oct 30 11:26:56 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:26:56 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/console.log" append="off"/>
Oct 30 11:26:56 user nova-compute[74278]:     </serial>
Oct 30 11:26:56 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:26:56 user nova-compute[74278]:     <video>
Oct 30 11:26:56 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:26:56 user nova-compute[74278]:     </video>
Oct 30 11:26:56 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:26:56 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:26:56 user nova-compute[74278]:     </rng>
Oct 30 11:26:56 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:26:56 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:26:56 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:26:56 user nova-compute[74278]:     </memballoon>
Oct 30 11:26:56 user nova-compute[74278]:   </devices>
Oct 30 11:26:56 user nova-compute[74278]: </domain>
Oct 30 11:26:56 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1497588327',display_name='tempest-TestMinimumBasicScenario-server-1497588327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1497588327',id=52,image_ref='1b0d2fb4-d151-4d7d-b7da-cb55d40aa847',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7j5x50HthJ4tyoc7JJ3s7oGpnBbgA5knRQGb36CewRyC6qEpxEtQkac22R1UbVt+x+6z70ZZkW2kiCarFPYBwrFhE6uXWI6Z9Bkx04DVvfYxEsNbFsSLJqYorY7JI6Og==',key_name='tempest-TestMinimumBasicScenario-1392120610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbe8ef99a57b49049a3266b974ba661b',ramdisk_id='',reservation_id='r-tn6iiyhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1b0d2fb4-d151-4d7d-b7da-cb55d40aa847',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-274954723',owner_user_name='tempest-TestMinimumBasicScenario-274954723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:26:55Z,user_data=None,user_id='03fb7307a64e4bcfb24ad4d337e12688',uuid=a3fca38e-c502-4111-8373-46491d806183,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converting VIF {"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:ae:c5,bridge_name='br-int',has_traffic_filtering=True,id=55a7d605-3793-4ff7-b0f7-6b375df45cf5,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a7d605-37') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG os_vif [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:ae:c5,bridge_name='br-int',has_traffic_filtering=True,id=55a7d605-3793-4ff7-b0f7-6b375df45cf5,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a7d605-37') {{(pid=74278) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3a99170-11ab-522f-b86a-45981e473cff', '_type': 'linux-noop'}}, row=False) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55a7d605-37, may_exist=True, interface_attrs={}) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55a7d605-37, col_values=(('qos', UUID('9127b4b9-21bc-4daa-ab91-4d364bfa62e4')),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55a7d605-37, col_values=(('external_ids', {'iface-id': '55a7d605-3793-4ff7-b0f7-6b375df45cf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:ae:c5', 'vm-uuid': 'a3fca38e-c502-4111-8373-46491d806183'}),), if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:56 user nova-compute[74278]: INFO os_vif [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:ae:c5,bridge_name='br-int',has_traffic_filtering=True,id=55a7d605-3793-4ff7-b0f7-6b375df45cf5,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a7d605-37')
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:26:56 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] No VIF found with MAC fa:16:3e:99:ae:c5, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG nova.network.neutron [req-81cb593d-49f4-4b0b-9911-bcc623c25c3e req-c16b9e44-77f5-4602-b89f-679f6f519094 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Updated VIF entry in instance network info cache for port 55a7d605-3793-4ff7-b0f7-6b375df45cf5. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG nova.network.neutron [req-81cb593d-49f4-4b0b-9911-bcc623c25c3e req-c16b9e44-77f5-4602-b89f-679f6f519094 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Updating instance_info_cache with network_info: [{"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-81cb593d-49f4-4b0b-9911-bcc623c25c3e req-c16b9e44-77f5-4602-b89f-679f6f519094 service nova] Releasing lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-80f9e815-1f95-4c9c-9e0a-e5dfbbd639ed req-152d4b45-9d1f-4d50-9a2a-4978070ad4dd service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-80f9e815-1f95-4c9c-9e0a-e5dfbbd639ed req-152d4b45-9d1f-4d50-9a2a-4978070ad4dd service nova] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-80f9e815-1f95-4c9c-9e0a-e5dfbbd639ed req-152d4b45-9d1f-4d50-9a2a-4978070ad4dd service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-80f9e815-1f95-4c9c-9e0a-e5dfbbd639ed req-152d4b45-9d1f-4d50-9a2a-4978070ad4dd service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-80f9e815-1f95-4c9c-9e0a-e5dfbbd639ed req-152d4b45-9d1f-4d50-9a2a-4978070ad4dd service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] No waiting events found dispatching network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:26:57 user nova-compute[74278]: WARNING nova.compute.manager [req-80f9e815-1f95-4c9c-9e0a-e5dfbbd639ed req-152d4b45-9d1f-4d50-9a2a-4978070ad4dd service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received unexpected event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 for instance with vm_state building and task_state spawning.
Oct 30 11:26:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] No waiting events found dispatching network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:26:59 user nova-compute[74278]: WARNING nova.compute.manager [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received unexpected event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 for instance with vm_state building and task_state spawning.
Oct 30 11:26:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] No waiting events found dispatching network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:26:59 user nova-compute[74278]: WARNING nova.compute.manager [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received unexpected event network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 for instance with vm_state building and task_state spawning.
Oct 30 11:26:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:26:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] No waiting events found dispatching network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:26:59 user nova-compute[74278]: WARNING nova.compute.manager [req-071e0d7d-fbe0-4220-8e39-336fe33ab23e req-f98dcffd-f401-479e-93c5-db284e56880d service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received unexpected event network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 for instance with vm_state building and task_state spawning.
Oct 30 11:27:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:27:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:27:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Instance spawned successfully.
Oct 30 11:27:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:27:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:27:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:27:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:27:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:27:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:27:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:27:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Instance event wait completed in 0 seconds for  {{(pid=74278) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 11:27:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Guest created on hypervisor {{(pid=74278) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 11:27:00 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a3fca38e-c502-4111-8373-46491d806183] Instance spawned successfully.
Oct 30 11:27:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Found default for hw_cdrom_bus of ide {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Found default for hw_disk_bus of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Found default for hw_input_bus of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Found default for hw_pointer_model of None {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Found default for hw_video_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Found default for hw_vif_model of virtio {{(pid=74278) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:01 user nova-compute[74278]: INFO nova.compute.manager [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Took 6.36 seconds to spawn the instance on the hypervisor.
Oct 30 11:27:01 user nova-compute[74278]: DEBUG nova.compute.manager [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:27:01 user nova-compute[74278]: INFO nova.compute.manager [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Took 7.52 seconds to spawn the instance on the hypervisor.
Oct 30 11:27:01 user nova-compute[74278]: DEBUG nova.compute.manager [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:01 user nova-compute[74278]: INFO nova.compute.manager [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Took 8.47 seconds to build instance.
Oct 30 11:27:01 user nova-compute[74278]: INFO nova.compute.manager [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Took 7.25 seconds to build instance.
Oct 30 11:27:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-db988e9f-f242-448e-8439-dfabf264b619 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.566s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-0f9010db-8604-40f9-a745-77364dbc06ee tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.417s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:27:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:27:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:03 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:27:03 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:27:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8449MB free_disk=24.803150177001953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 30695565-3d1f-48b8-b85a-19f9e9a28196 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 31586a40-57a5-48f7-8b0d-07b58b7f1fb5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a3fca38e-c502-4111-8373-46491d806183 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:27:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:13 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:27:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:19 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:27:19 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 11:27:19 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] There are 0 instances to clean {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 11:27:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_power_states {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 85e83e56-3a30-4c75-b480-b1d298352888 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 30695565-3d1f-48b8-b85a-19f9e9a28196 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 31586a40-57a5-48f7-8b0d-07b58b7f1fb5 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Triggering sync for uuid a3fca38e-c502-4111-8373-46491d806183 {{(pid=74278) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "85e83e56-3a30-4c75-b480-b1d298352888" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "85e83e56-3a30-4c75-b480-b1d298352888" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "30695565-3d1f-48b8-b85a-19f9e9a28196" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "a3fca38e-c502-4111-8373-46491d806183" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "85e83e56-3a30-4c75-b480-b1d298352888" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "a3fca38e-c502-4111-8373-46491d806183" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:27:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:27:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:27:51 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:27:51 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:27:51 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:27:51 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:27:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:52 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:27:53 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:27:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:27:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 11:27:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:27:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:27:53 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:27:53 user nova-compute[74278]: DEBUG nova.objects.instance [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lazy-loading 'info_cache' on Instance uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:27:54 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updating instance_info_cache with network_info: [{"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:27:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:27:54 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:27:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:27:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:27:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-58259d81-42d6-4318-8777-358cf7159134 req-f2e07853-ea00-4d4d-be31-1b3cb813d73e service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Received event network-changed-133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:27:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-58259d81-42d6-4318-8777-358cf7159134 req-f2e07853-ea00-4d4d-be31-1b3cb813d73e service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Refreshing instance network info cache due to event network-changed-133bb17e-f1b4-4696-b7b8-9c1d2b921efc. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:27:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-58259d81-42d6-4318-8777-358cf7159134 req-f2e07853-ea00-4d4d-be31-1b3cb813d73e service nova] Acquiring lock "refresh_cache-31586a40-57a5-48f7-8b0d-07b58b7f1fb5" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:27:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-58259d81-42d6-4318-8777-358cf7159134 req-f2e07853-ea00-4d4d-be31-1b3cb813d73e service nova] Acquired lock "refresh_cache-31586a40-57a5-48f7-8b0d-07b58b7f1fb5" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:27:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-58259d81-42d6-4318-8777-358cf7159134 req-f2e07853-ea00-4d4d-be31-1b3cb813d73e service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Refreshing network info cache for port 133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:27:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-58259d81-42d6-4318-8777-358cf7159134 req-f2e07853-ea00-4d4d-be31-1b3cb813d73e service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Updated VIF entry in instance network info cache for port 133bb17e-f1b4-4696-b7b8-9c1d2b921efc. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:27:55 user nova-compute[74278]: DEBUG nova.network.neutron [req-58259d81-42d6-4318-8777-358cf7159134 req-f2e07853-ea00-4d4d-be31-1b3cb813d73e service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Updating instance_info_cache with network_info: [{"id": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "address": "fa:16:3e:2f:fc:4e", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bb17e-f1", "ovs_interfaceid": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:27:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-58259d81-42d6-4318-8777-358cf7159134 req-f2e07853-ea00-4d4d-be31-1b3cb813d73e service nova] Releasing lock "refresh_cache-31586a40-57a5-48f7-8b0d-07b58b7f1fb5" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:56 user nova-compute[74278]: INFO nova.compute.manager [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Terminating instance
Oct 30 11:27:56 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-c216649c-d0c4-445a-8a8a-3cfd6b6f5c3c req-1768eb9f-23c3-4900-9bf4-4c13706b6446 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Received event network-vif-unplugged-133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c216649c-d0c4-445a-8a8a-3cfd6b6f5c3c req-1768eb9f-23c3-4900-9bf4-4c13706b6446 service nova] Acquiring lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c216649c-d0c4-445a-8a8a-3cfd6b6f5c3c req-1768eb9f-23c3-4900-9bf4-4c13706b6446 service nova] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c216649c-d0c4-445a-8a8a-3cfd6b6f5c3c req-1768eb9f-23c3-4900-9bf4-4c13706b6446 service nova] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-c216649c-d0c4-445a-8a8a-3cfd6b6f5c3c req-1768eb9f-23c3-4900-9bf4-4c13706b6446 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] No waiting events found dispatching network-vif-unplugged-133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG nova.compute.manager [req-c216649c-d0c4-445a-8a8a-3cfd6b6f5c3c req-1768eb9f-23c3-4900-9bf4-4c13706b6446 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Received event network-vif-unplugged-133bb17e-f1b4-4696-b7b8-9c1d2b921efc for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:27:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Instance destroyed successfully.
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.objects.instance [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lazy-loading 'resources' on Instance uuid 31586a40-57a5-48f7-8b0d-07b58b7f1fb5 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:26:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-864542468',display_name='tempest-TestVolumeBootPattern-server-864542468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-864542468',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwVoOsdyxK0SNJwN4HZdm83195LyA9Z0y2NGjM0FwHB0Pi1YZz1ojqsLwPsv+2VzYnIe6fA5rtOwUJoMGSzNFwd6qP/wjrkBI6PJWy0NWF/x6FOi1/pKN50JcP0R1EE6Q==',key_name='tempest-TestVolumeBootPattern-1784921068',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:26:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-az999nzl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:26:28Z,user_data=None,user_id='e921926b3790497fb9630088c501af82',uuid=31586a40-57a5-48f7-8b0d-07b58b7f1fb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "address": "fa:16:3e:2f:fc:4e", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bb17e-f1", "ovs_interfaceid": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "address": "fa:16:3e:2f:fc:4e", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bb17e-f1", "ovs_interfaceid": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:fc:4e,bridge_name='br-int',has_traffic_filtering=True,id=133bb17e-f1b4-4696-b7b8-9c1d2b921efc,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bb17e-f1') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_vif [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:fc:4e,bridge_name='br-int',has_traffic_filtering=True,id=133bb17e-f1b4-4696-b7b8-9c1d2b921efc,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bb17e-f1') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap133bb17e-f1, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c3512d4-88c0-4d47-ad5a-1362df3bc4f1) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:27:57 user nova-compute[74278]: INFO os_vif [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:fc:4e,bridge_name='br-int',has_traffic_filtering=True,id=133bb17e-f1b4-4696-b7b8-9c1d2b921efc,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap133bb17e-f1')
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UKFWCkQz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:27:57 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[27839624-e488-466f-aa72-4ff5a7f42202]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:27:57 user nova-compute[74278]: No targets found.
Oct 30 11:27:57 user nova-compute[74278]: iSNS:
Oct 30 11:27:57 user nova-compute[74278]: No targets found.
Oct 30 11:27:57 user nova-compute[74278]: STATIC:
Oct 30 11:27:57 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542
Oct 30 11:27:57 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:27:57 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:27:57 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26
Oct 30 11:27:57 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:27:57 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:27:57 user nova-compute[74278]: FIRMWARE:
Oct 30 11:27:57 user nova-compute[74278]: No targets found.
Oct 30 11:27:57 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:27:57 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:27:57 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[68dd81f9-a199-4f61-98a0-4ae760807c77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccafc5ef-be5e-4402-ab3a-2348ec114fca]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:27:57 user nova-compute[74278]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 (non-flash)
Oct 30 11:27:57 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:27:57 user nova-compute[74278]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 (non-flash)
Oct 30 11:27:57 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c31c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c112fba-766c-49ff-84a1-01ddd374fc62]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bdd1f7-2523-4b03-bfa8-a0368d423c21]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8f607e-6c3f-4ac2-8132-20b2b7715182]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6d261a-3e33-4731-9971-9a80b22e1066]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23337623466663939', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e32bdc86', '/dev/disk/by-id/scsi-1SCST_BIOe32bdc86-37b4ff99fd5531e5') {{(pid=85487) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[137d9c7d-52b3-4f2e-af54-ecf27c1f45ae]: (4, None) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-53fca04a-48f8-4ee7-b25d-e36da703895f req-252edeec-dc8b-4838-93b6-55fcb43e47ae service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Received event network-changed-133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-53fca04a-48f8-4ee7-b25d-e36da703895f req-252edeec-dc8b-4838-93b6-55fcb43e47ae service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Refreshing instance network info cache due to event network-changed-133bb17e-f1b4-4696-b7b8-9c1d2b921efc. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-53fca04a-48f8-4ee7-b25d-e36da703895f req-252edeec-dc8b-4838-93b6-55fcb43e47ae service nova] Acquiring lock "refresh_cache-31586a40-57a5-48f7-8b0d-07b58b7f1fb5" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-53fca04a-48f8-4ee7-b25d-e36da703895f req-252edeec-dc8b-4838-93b6-55fcb43e47ae service nova] Acquired lock "refresh_cache-31586a40-57a5-48f7-8b0d-07b58b7f1fb5" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.network.neutron [req-53fca04a-48f8-4ee7-b25d-e36da703895f req-252edeec-dc8b-4838-93b6-55fcb43e47ae service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Refreshing network info cache for port 133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34ae247-141d-4363-b2f7-74d208a8d839]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[464412d1-47f4-4b6b-80c9-f7c9309fb04d]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542, portal: 172.16.0.220,3260]
Oct 30 11:27:57 user nova-compute[74278]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542, portal: 172.16.0.220,3260] successful.
Oct 30 11:27:57 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa201d4-e1e9-4eb3-85d4-538ba903c542 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6b9288-81af-4c0e-93f8-dded95806071]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== disconnect_volume: return (308ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:27:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Deleting instance files /opt/stack/data/nova/instances/31586a40-57a5-48f7-8b0d-07b58b7f1fb5_del
Oct 30 11:27:57 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Deletion of /opt/stack/data/nova/instances/31586a40-57a5-48f7-8b0d-07b58b7f1fb5_del complete
Oct 30 11:27:57 user nova-compute[74278]: INFO nova.compute.manager [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.network.neutron [req-53fca04a-48f8-4ee7-b25d-e36da703895f req-252edeec-dc8b-4838-93b6-55fcb43e47ae service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Updated VIF entry in instance network info cache for port 133bb17e-f1b4-4696-b7b8-9c1d2b921efc. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.network.neutron [req-53fca04a-48f8-4ee7-b25d-e36da703895f req-252edeec-dc8b-4838-93b6-55fcb43e47ae service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Updating instance_info_cache with network_info: [{"id": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "address": "fa:16:3e:2f:fc:4e", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap133bb17e-f1", "ovs_interfaceid": "133bb17e-f1b4-4696-b7b8-9c1d2b921efc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-53fca04a-48f8-4ee7-b25d-e36da703895f req-252edeec-dc8b-4838-93b6-55fcb43e47ae service nova] Releasing lock "refresh_cache-31586a40-57a5-48f7-8b0d-07b58b7f1fb5" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:27:57 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Took 0.45 seconds to deallocate network for instance.
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-3ebf74d2-c448-464c-9e4f-44d0fa19266d req-6b74b7d4-a520-46bf-9606-964140824876 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Received event network-vif-deleted-133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:27:57 user nova-compute[74278]: INFO nova.compute.manager [req-3ebf74d2-c448-464c-9e4f-44d0fa19266d req-6b74b7d4-a520-46bf-9606-964140824876 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Neutron deleted interface 133bb17e-f1b4-4696-b7b8-9c1d2b921efc; detaching it from the instance and deleting it from the info cache
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.network.neutron [req-3ebf74d2-c448-464c-9e4f-44d0fa19266d req-6b74b7d4-a520-46bf-9606-964140824876 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:27:57 user nova-compute[74278]: DEBUG nova.compute.manager [req-3ebf74d2-c448-464c-9e4f-44d0fa19266d req-6b74b7d4-a520-46bf-9606-964140824876 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Detach interface failed, port_id=133bb17e-f1b4-4696-b7b8-9c1d2b921efc, reason: Instance 31586a40-57a5-48f7-8b0d-07b58b7f1fb5 could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:27:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-1e7ff4e6-c403-4a97-bc2d-0ee3ac5c3f5c req-eb0e35c5-d571-4822-aea0-0114cf7756f3 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Received event network-vif-plugged-133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:27:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1e7ff4e6-c403-4a97-bc2d-0ee3ac5c3f5c req-eb0e35c5-d571-4822-aea0-0114cf7756f3 service nova] Acquiring lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1e7ff4e6-c403-4a97-bc2d-0ee3ac5c3f5c req-eb0e35c5-d571-4822-aea0-0114cf7756f3 service nova] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-1e7ff4e6-c403-4a97-bc2d-0ee3ac5c3f5c req-eb0e35c5-d571-4822-aea0-0114cf7756f3 service nova] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:58 user nova-compute[74278]: DEBUG nova.compute.manager [req-1e7ff4e6-c403-4a97-bc2d-0ee3ac5c3f5c req-eb0e35c5-d571-4822-aea0-0114cf7756f3 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] No waiting events found dispatching network-vif-plugged-133bb17e-f1b4-4696-b7b8-9c1d2b921efc {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:27:58 user nova-compute[74278]: WARNING nova.compute.manager [req-1e7ff4e6-c403-4a97-bc2d-0ee3ac5c3f5c req-eb0e35c5-d571-4822-aea0-0114cf7756f3 service nova] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Received unexpected event network-vif-plugged-133bb17e-f1b4-4696-b7b8-9c1d2b921efc for instance with vm_state active and task_state deleting.
Oct 30 11:27:58 user nova-compute[74278]: INFO nova.compute.manager [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 31586a40-57a5-48f7-8b0d-07b58b7f1fb5] Took 0.84 seconds to detach 1 volumes for instance.
Oct 30 11:27:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:59 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Deleted allocations for instance 31586a40-57a5-48f7-8b0d-07b58b7f1fb5
Oct 30 11:27:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ef57163d-a9cb-46aa-aa6e-fccfbbc2b703 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "31586a40-57a5-48f7-8b0d-07b58b7f1fb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.894s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:27:59 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:01 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:28:01 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:28:01 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8409MB free_disk=24.744598388671875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 30695565-3d1f-48b8-b85a-19f9e9a28196 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a3fca38e-c502-4111-8373-46491d806183 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:28:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:28:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:28:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:28:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:28:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:28:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:28:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:17 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:28:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:28:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:28:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:28:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:28:27 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:32 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:42 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-33196675-fe2e-45ec-b226-114e44da4215 req-4121b1ef-3931-491a-9d8b-da753cb5a107 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-changed-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:28:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-33196675-fe2e-45ec-b226-114e44da4215 req-4121b1ef-3931-491a-9d8b-da753cb5a107 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Refreshing instance network info cache due to event network-changed-bee51f46-936e-44f3-bc9d-60bc94025b37. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:28:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-33196675-fe2e-45ec-b226-114e44da4215 req-4121b1ef-3931-491a-9d8b-da753cb5a107 service nova] Acquiring lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:28:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-33196675-fe2e-45ec-b226-114e44da4215 req-4121b1ef-3931-491a-9d8b-da753cb5a107 service nova] Acquired lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:28:43 user nova-compute[74278]: DEBUG nova.network.neutron [req-33196675-fe2e-45ec-b226-114e44da4215 req-4121b1ef-3931-491a-9d8b-da753cb5a107 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Refreshing network info cache for port bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'flavor' on Instance uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:28:44 user nova-compute[74278]: INFO nova.compute.manager [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Attaching volume 92e356d4-121e-435e-b065-10e9c88a0c1a to /dev/vdb
Oct 30 11:28:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-33196675-fe2e-45ec-b226-114e44da4215 req-4121b1ef-3931-491a-9d8b-da753cb5a107 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updated VIF entry in instance network info cache for port bee51f46-936e-44f3-bc9d-60bc94025b37. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG nova.network.neutron [req-33196675-fe2e-45ec-b226-114e44da4215 req-4121b1ef-3931-491a-9d8b-da753cb5a107 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updating instance_info_cache with network_info: [{"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-33196675-fe2e-45ec-b226-114e44da4215 req-4121b1ef-3931-491a-9d8b-da753cb5a107 service nova] Releasing lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG os_brick.utils [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a8c72d-8d1c-4663-a0ea-8a0d82c37ebc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ecf717-0d35-4e28-9cff-81ec4efec937]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1414e44c-b44e-4d94-9925-d71767aa9d33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3019460-0a8a-468e-af61-85586d7ab525]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:28:44 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:28:44 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fc9ab6-ca4b-4f80-b3d2-61f4cd34a77f]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG os_brick.utils [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:28:44 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updating existing volume attachment record: a85dec70-edee-4943-99e7-22e2e4727a1d {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:28:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:47 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG nova.objects.instance [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'flavor' on Instance uuid a3fca38e-c502-4111-8373-46491d806183 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:28:50 user nova-compute[74278]: INFO nova.compute.manager [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Attaching volume 3526655e-ebe9-4341-a0b1-ee8881d42a4a to /dev/vdb
Oct 30 11:28:50 user nova-compute[74278]: DEBUG os_brick.utils [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12c5b1e-9e97-4de2-be78-6aa964b6013b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:a74659a6dddb\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e89b03-d4d4-4e94-8546-bea27be7a48e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4e4ae9-38da-4a24-a21a-82651ed1af85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b77eff-6d24-40f8-8b83-527f8ed8cbbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Running cmd (subprocess): nvme version {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] 'nvme version' failed. Not Retrying. {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] nvme not present on system {{(pid=74278) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 11:28:50 user nova-compute[74278]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a710062-da3f-4add-bc0f-6cc4da218089]: (4, '') {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74278) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.lightos [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] LIGHTOS: no hostnqn found. {{(pid=74278) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG os_brick.utils [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:a74659a6dddb', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG nova.virt.block_device [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Updating existing volume attachment record: 69d00257-4412-41f9-89da-d9275d9521d9 {{(pid=74278) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:50 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:28:51 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:28:51 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:28:52 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:28:52 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:28:52 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:28:53 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:28:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:28:55 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:28:55 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:28:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:28:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:28:55 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:28:55 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updating instance_info_cache with network_info: [{"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:28:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:28:55 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:28:55 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:28:57 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:00 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:29:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:00 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:29:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:00 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:29:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:02 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:02 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:29:02 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:29:02 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8533MB free_disk=24.743419647216797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:29:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:29:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:29:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 30695565-3d1f-48b8-b85a-19f9e9a28196 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:29:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:29:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a3fca38e-c502-4111-8373-46491d806183 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:29:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:29:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:29:03 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:29:03 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:29:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:29:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmprgZsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:29:04 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:29:04 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:29:04 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5550943-a9dc-4147-b49d-f938c97c29fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:29:04 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb5e681-ffc1-438d-9466-3865ba3b1665]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a] added
Oct 30 11:29:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[54503c4f-0873-4e7c-a19d-ee94764bd045]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f66981-0f17-4643-8381-922d4f8a6e40]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JmprgZsA {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JmprgZsA" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[497c40b8-fc00-4526-bd93-aaeb3a945782]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JmprgZsA'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5aae741-09c7-491a-89aa-c2b816e5ff37]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[585f14ad-a7db-4d44-bdf6-de7362c9514e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:29:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:29:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[3648bad2-99cb-4b34-8873-bb6b2e621dd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a, portal: 172.16.0.220,3260]
Oct 30 11:29:04 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a, portal: 172.16.0.220,3260] successful.
Oct 30 11:29:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[676afe4f-f197-41b5-8c70-9089beb62447]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9fe596-9aa3-4e87-9422-dc79de94dd5e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:29:04 user nova-compute[74278]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)
Oct 30 11:29:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:29:04 user nova-compute[74278]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)
Oct 30 11:29:04 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a6a945-6c2d-40f6-aae2-82ef50659037]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:29:04 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmprgZsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:29:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:29:05 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23430393637623865', 'path': '/dev/sdb'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:29:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430393637623865', 'path': '/dev/sdb'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:29:05 user nova-compute[74278]: DEBUG nova.objects.instance [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'flavor' on Instance uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:29:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:29:05 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:29:05 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:29:05 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:29:05 user nova-compute[74278]:   <serial>92e356d4-121e-435e-b065-10e9c88a0c1a</serial>
Oct 30 11:29:05 user nova-compute[74278]: </disk>
Oct 30 11:29:05 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:29:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:29:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:29:05 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No VIF found with MAC fa:16:3e:fa:b4:2e, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:29:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-9081dc16-1907-4796-b246-bef469fdca2b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.695s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:29:07 user nova-compute[74278]: INFO nova.compute.manager [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Rescuing
Oct 30 11:29:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:29:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquired lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:29:07 user nova-compute[74278]: DEBUG nova.network.neutron [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:29:07 user nova-compute[74278]: DEBUG nova.network.neutron [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updating instance_info_cache with network_info: [{"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:29:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Releasing lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:29:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:07 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-0d9c36b9-8181-425e-a9f1-0ad0dfe4a502 req-8fa5e713-4611-4d8f-afa0-c07ea00a38d1 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-unplugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0d9c36b9-8181-425e-a9f1-0ad0dfe4a502 req-8fa5e713-4611-4d8f-afa0-c07ea00a38d1 service nova] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0d9c36b9-8181-425e-a9f1-0ad0dfe4a502 req-8fa5e713-4611-4d8f-afa0-c07ea00a38d1 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0d9c36b9-8181-425e-a9f1-0ad0dfe4a502 req-8fa5e713-4611-4d8f-afa0-c07ea00a38d1 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:07 user nova-compute[74278]: DEBUG nova.compute.manager [req-0d9c36b9-8181-425e-a9f1-0ad0dfe4a502 req-8fa5e713-4611-4d8f-afa0-c07ea00a38d1 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] No waiting events found dispatching network-vif-unplugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:29:07 user nova-compute[74278]: WARNING nova.compute.manager [req-0d9c36b9-8181-425e-a9f1-0ad0dfe4a502 req-8fa5e713-4611-4d8f-afa0-c07ea00a38d1 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received unexpected event network-vif-unplugged-bee51f46-936e-44f3-bc9d-60bc94025b37 for instance with vm_state active and task_state rescuing.
Oct 30 11:29:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:08 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Instance destroyed successfully.
Oct 30 11:29:08 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Attempting rescue
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74278) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Instance directory exists: not creating {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 11:29:08 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Creating image(s)
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "/opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "/opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.objects.instance [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-94d7bd46-ba9c-464e-93a5-aca1ead557a8 req-303c4766-1b91-47ad-baae-068356821f28 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Received event network-changed-96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.compute.manager [req-94d7bd46-ba9c-464e-93a5-aca1ead557a8 req-303c4766-1b91-47ad-baae-068356821f28 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Refreshing instance network info cache due to event network-changed-96d00d41-05f1-4e9c-8cea-b85bf7a79187. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-94d7bd46-ba9c-464e-93a5-aca1ead557a8 req-303c4766-1b91-47ad-baae-068356821f28 service nova] Acquiring lock "refresh_cache-30695565-3d1f-48b8-b85a-19f9e9a28196" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-94d7bd46-ba9c-464e-93a5-aca1ead557a8 req-303c4766-1b91-47ad-baae-068356821f28 service nova] Acquired lock "refresh_cache-30695565-3d1f-48b8-b85a-19f9e9a28196" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.network.neutron [req-94d7bd46-ba9c-464e-93a5-aca1ead557a8 req-303c4766-1b91-47ad-baae-068356821f28 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Refreshing network info cache for port 96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0 --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.rescue {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0,backing_fmt=raw /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.rescue" returned: 0 in 0.051s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "3f63e4162bd2dc8a0658f1f9d5adc307b2ed18e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.objects.instance [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'migration_context' on Instance uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "30695565-3d1f-48b8-b85a-19f9e9a28196" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.objects.base [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<0a11cbf9-03bd-4f17-9fc8-41e095780fe9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Created local disks {{(pid=74278) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Start _get_guest_xml network_info=[{"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "vif_mac": "fa:16:3e:fa:b4:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4107584d-f654-453b-972a-abcf1c7a0671', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.objects.instance [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'resources' on Instance uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:29:08 user nova-compute[74278]: INFO nova.compute.manager [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Terminating instance
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.compute.manager [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.objects.base [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<0a11cbf9-03bd-4f17-9fc8-41e095780fe9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.objects.instance [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'numa_topology' on Instance uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.objects.base [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<0a11cbf9-03bd-4f17-9fc8-41e095780fe9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:29:08 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:29:08 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU controller missing on host. {{(pid=74278) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.host [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU controller found on host. {{(pid=74278) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74278) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T10:46:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T10:46:41Z,direct_url=<?>,disk_format='qcow2',id=4107584d-f654-453b-972a-abcf1c7a0671,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bad695133afe4787b2a24160056a5ca7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T10:46:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flavor limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Image limits 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flavor pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Image pref 0:0:0 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Got 1 possible topologies {{(pid=74278) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.hardware [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74278) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.objects.instance [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.objects.base [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<0a11cbf9-03bd-4f17-9fc8-41e095780fe9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-511782841',display_name='tempest-ServerRescueNegativeTestJSON-server-511782841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-511782841',id=51,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAqL4y+XnS+gly0VAbSOSvcpyqUTX/mfD36u6nFufbYk5xGRXwyztWf2UqC7vTAFoG2vnZLg/CBBePeDiB60SF9Mz+V2MwUf8wzawoByo6mCN97zQ65zjHEq5uT1I/19A==',key_name='tempest-keypair-1125188050',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:27:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a881207e0d4a4314a979e3af56cf2f95',ramdisk_id='',reservation_id='r-3id3wdaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2065673492',owner_user_name='tempest-ServerRescueNegativeTestJSON-2065673492-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T11:27:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad932a451724349a5c40964d7e75157',uuid=0a11cbf9-03bd-4f17-9fc8-41e095780fe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "vif_mac": "fa:16:3e:fa:b4:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74278) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converting VIF {"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "vif_mac": "fa:16:3e:fa:b4:2e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:b4:2e,bridge_name='br-int',has_traffic_filtering=True,id=bee51f46-936e-44f3-bc9d-60bc94025b37,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee51f46-93') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.objects.instance [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.objects.base [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Object Instance<0a11cbf9-03bd-4f17-9fc8-41e095780fe9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74278) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] End _get_guest_xml xml=<domain type="kvm">
Oct 30 11:29:08 user nova-compute[74278]:   <uuid>0a11cbf9-03bd-4f17-9fc8-41e095780fe9</uuid>
Oct 30 11:29:08 user nova-compute[74278]:   <name>instance-00000033</name>
Oct 30 11:29:08 user nova-compute[74278]:   <memory>524288</memory>
Oct 30 11:29:08 user nova-compute[74278]:   <vcpu>1</vcpu>
Oct 30 11:29:08 user nova-compute[74278]:   <metadata>
Oct 30 11:29:08 user nova-compute[74278]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 11:29:08 user nova-compute[74278]:       <nova:package version="0.0.0"/>
Oct 30 11:29:08 user nova-compute[74278]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-511782841</nova:name>
Oct 30 11:29:08 user nova-compute[74278]:       <nova:creationTime>2023-10-30 11:29:08</nova:creationTime>
Oct 30 11:29:08 user nova-compute[74278]:       <nova:flavor name="m1.tiny">
Oct 30 11:29:08 user nova-compute[74278]:         <nova:memory>512</nova:memory>
Oct 30 11:29:08 user nova-compute[74278]:         <nova:disk>1</nova:disk>
Oct 30 11:29:08 user nova-compute[74278]:         <nova:swap>0</nova:swap>
Oct 30 11:29:08 user nova-compute[74278]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 11:29:08 user nova-compute[74278]:         <nova:vcpus>1</nova:vcpus>
Oct 30 11:29:08 user nova-compute[74278]:       </nova:flavor>
Oct 30 11:29:08 user nova-compute[74278]:       <nova:owner>
Oct 30 11:29:08 user nova-compute[74278]:         <nova:user uuid="8ad932a451724349a5c40964d7e75157">tempest-ServerRescueNegativeTestJSON-2065673492-project-member</nova:user>
Oct 30 11:29:08 user nova-compute[74278]:         <nova:project uuid="a881207e0d4a4314a979e3af56cf2f95">tempest-ServerRescueNegativeTestJSON-2065673492</nova:project>
Oct 30 11:29:08 user nova-compute[74278]:       </nova:owner>
Oct 30 11:29:08 user nova-compute[74278]:       <nova:root type="image" uuid="4107584d-f654-453b-972a-abcf1c7a0671"/>
Oct 30 11:29:08 user nova-compute[74278]:       <nova:ports>
Oct 30 11:29:08 user nova-compute[74278]:         <nova:port uuid="bee51f46-936e-44f3-bc9d-60bc94025b37">
Oct 30 11:29:08 user nova-compute[74278]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 11:29:08 user nova-compute[74278]:         </nova:port>
Oct 30 11:29:08 user nova-compute[74278]:       </nova:ports>
Oct 30 11:29:08 user nova-compute[74278]:     </nova:instance>
Oct 30 11:29:08 user nova-compute[74278]:   </metadata>
Oct 30 11:29:08 user nova-compute[74278]:   <sysinfo type="smbios">
Oct 30 11:29:08 user nova-compute[74278]:     <system>
Oct 30 11:29:08 user nova-compute[74278]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 11:29:08 user nova-compute[74278]:       <entry name="product">OpenStack Nova</entry>
Oct 30 11:29:08 user nova-compute[74278]:       <entry name="version">0.0.0</entry>
Oct 30 11:29:08 user nova-compute[74278]:       <entry name="serial">0a11cbf9-03bd-4f17-9fc8-41e095780fe9</entry>
Oct 30 11:29:08 user nova-compute[74278]:       <entry name="uuid">0a11cbf9-03bd-4f17-9fc8-41e095780fe9</entry>
Oct 30 11:29:08 user nova-compute[74278]:       <entry name="family">Virtual Machine</entry>
Oct 30 11:29:08 user nova-compute[74278]:     </system>
Oct 30 11:29:08 user nova-compute[74278]:   </sysinfo>
Oct 30 11:29:08 user nova-compute[74278]:   <os>
Oct 30 11:29:08 user nova-compute[74278]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 11:29:08 user nova-compute[74278]:     <smbios mode="sysinfo"/>
Oct 30 11:29:08 user nova-compute[74278]:   </os>
Oct 30 11:29:08 user nova-compute[74278]:   <features>
Oct 30 11:29:08 user nova-compute[74278]:     <acpi/>
Oct 30 11:29:08 user nova-compute[74278]:     <apic/>
Oct 30 11:29:08 user nova-compute[74278]:     <vmcoreinfo/>
Oct 30 11:29:08 user nova-compute[74278]:   </features>
Oct 30 11:29:08 user nova-compute[74278]:   <clock offset="utc">
Oct 30 11:29:08 user nova-compute[74278]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 11:29:08 user nova-compute[74278]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 11:29:08 user nova-compute[74278]:     <timer name="hpet" present="no"/>
Oct 30 11:29:08 user nova-compute[74278]:   </clock>
Oct 30 11:29:08 user nova-compute[74278]:   <cpu mode="custom" match="exact">
Oct 30 11:29:08 user nova-compute[74278]:     <model>Nehalem</model>
Oct 30 11:29:08 user nova-compute[74278]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 11:29:08 user nova-compute[74278]:   </cpu>
Oct 30 11:29:08 user nova-compute[74278]:   <devices>
Oct 30 11:29:08 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:29:08 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:29:08 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.rescue"/>
Oct 30 11:29:08 user nova-compute[74278]:       <target dev="vda" bus="virtio"/>
Oct 30 11:29:08 user nova-compute[74278]:     </disk>
Oct 30 11:29:08 user nova-compute[74278]:     <disk type="file" device="disk">
Oct 30 11:29:08 user nova-compute[74278]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 11:29:08 user nova-compute[74278]:       <source file="/opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk"/>
Oct 30 11:29:08 user nova-compute[74278]:       <target dev="vdb" bus="virtio"/>
Oct 30 11:29:08 user nova-compute[74278]:     </disk>
Oct 30 11:29:08 user nova-compute[74278]:     <interface type="ethernet">
Oct 30 11:29:08 user nova-compute[74278]:       <mac address="fa:16:3e:fa:b4:2e"/>
Oct 30 11:29:08 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:29:08 user nova-compute[74278]:       <mtu size="1442"/>
Oct 30 11:29:08 user nova-compute[74278]:       <target dev="tapbee51f46-93"/>
Oct 30 11:29:08 user nova-compute[74278]:     </interface>
Oct 30 11:29:08 user nova-compute[74278]:     <serial type="pty">
Oct 30 11:29:08 user nova-compute[74278]:       <log file="/opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/console.log" append="off"/>
Oct 30 11:29:08 user nova-compute[74278]:     </serial>
Oct 30 11:29:08 user nova-compute[74278]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 11:29:08 user nova-compute[74278]:     <video>
Oct 30 11:29:08 user nova-compute[74278]:       <model type="virtio"/>
Oct 30 11:29:08 user nova-compute[74278]:     </video>
Oct 30 11:29:08 user nova-compute[74278]:     <rng model="virtio">
Oct 30 11:29:08 user nova-compute[74278]:       <backend model="random">/dev/urandom</backend>
Oct 30 11:29:08 user nova-compute[74278]:     </rng>
Oct 30 11:29:08 user nova-compute[74278]:     <controller type="usb" index="0" model="none"/>
Oct 30 11:29:08 user nova-compute[74278]:     <memballoon model="virtio">
Oct 30 11:29:08 user nova-compute[74278]:       <stats period="10"/>
Oct 30 11:29:08 user nova-compute[74278]:     </memballoon>
Oct 30 11:29:08 user nova-compute[74278]:   </devices>
Oct 30 11:29:08 user nova-compute[74278]: </domain>
Oct 30 11:29:08 user nova-compute[74278]:  {{(pid=74278) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:08 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Instance destroyed successfully.
Oct 30 11:29:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:29:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:29:09 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] No VIF found with MAC fa:16:3e:fa:b4:2e, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:29:09 user nova-compute[74278]: DEBUG nova.network.neutron [req-94d7bd46-ba9c-464e-93a5-aca1ead557a8 req-303c4766-1b91-47ad-baae-068356821f28 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Updated VIF entry in instance network info cache for port 96d00d41-05f1-4e9c-8cea-b85bf7a79187. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:29:09 user nova-compute[74278]: DEBUG nova.network.neutron [req-94d7bd46-ba9c-464e-93a5-aca1ead557a8 req-303c4766-1b91-47ad-baae-068356821f28 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Updating instance_info_cache with network_info: [{"id": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "address": "fa:16:3e:d6:95:88", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d00d41-05", "ovs_interfaceid": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:29:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-94d7bd46-ba9c-464e-93a5-aca1ead557a8 req-303c4766-1b91-47ad-baae-068356821f28 service nova] Releasing lock "refresh_cache-30695565-3d1f-48b8-b85a-19f9e9a28196" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:29:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] No waiting events found dispatching network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:29:10 user nova-compute[74278]: WARNING nova.compute.manager [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received unexpected event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 for instance with vm_state active and task_state rescuing.
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Received event network-vif-unplugged-96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] Acquiring lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] No waiting events found dispatching network-vif-unplugged-96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Received event network-vif-unplugged-96d00d41-05f1-4e9c-8cea-b85bf7a79187 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Received event network-vif-plugged-96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] Acquiring lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.compute.manager [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] No waiting events found dispatching network-vif-plugged-96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:29:10 user nova-compute[74278]: WARNING nova.compute.manager [req-2c26cc94-1368-4c3a-b001-ff8127c80659 req-bf972f2d-d7fb-424c-974e-96450fe8a783 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Received unexpected event network-vif-plugged-96d00d41-05f1-4e9c-8cea-b85bf7a79187 for instance with vm_state active and task_state deleting.
Oct 30 11:29:10 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Instance destroyed successfully.
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.objects.instance [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lazy-loading 'resources' on Instance uuid 30695565-3d1f-48b8-b85a-19f9e9a28196 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:23:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2111827443',display_name='tempest-TestVolumeBootPattern-server-2111827443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2111827443',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwVoOsdyxK0SNJwN4HZdm83195LyA9Z0y2NGjM0FwHB0Pi1YZz1ojqsLwPsv+2VzYnIe6fA5rtOwUJoMGSzNFwd6qP/wjrkBI6PJWy0NWF/x6FOi1/pKN50JcP0R1EE6Q==',key_name='tempest-TestVolumeBootPattern-1784921068',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:24:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59235488214e4149a91d6c2d5a02dd21',ramdisk_id='',reservation_id='r-8d22jvvu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2008975673',owner_user_name='tempest-TestVolumeBootPattern-2008975673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:24:17Z,user_data=None,user_id='e921926b3790497fb9630088c501af82',uuid=30695565-3d1f-48b8-b85a-19f9e9a28196,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "address": "fa:16:3e:d6:95:88", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d00d41-05", "ovs_interfaceid": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converting VIF {"id": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "address": "fa:16:3e:d6:95:88", "network": {"id": "3059e487-02e5-47d9-9c99-a5af53bf3cba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-197981528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59235488214e4149a91d6c2d5a02dd21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d00d41-05", "ovs_interfaceid": "96d00d41-05f1-4e9c-8cea-b85bf7a79187", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:95:88,bridge_name='br-int',has_traffic_filtering=True,id=96d00d41-05f1-4e9c-8cea-b85bf7a79187,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d00d41-05') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_vif [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:95:88,bridge_name='br-int',has_traffic_filtering=True,id=96d00d41-05f1-4e9c-8cea-b85bf7a79187,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d00d41-05') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96d00d41-05, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c84255c5-6bb0-452e-b1a1-1f91882cb416) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: INFO os_vif [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:95:88,bridge_name='br-int',has_traffic_filtering=True,id=96d00d41-05f1-4e9c-8cea-b85bf7a79187,network=Network(3059e487-02e5-47d9-9c99-a5af53bf3cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d00d41-05')
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTgBXSyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:29:10 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd930f0-5082-4b8f-a648-0379d112b49d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:29:10 user nova-compute[74278]: No targets found.
Oct 30 11:29:10 user nova-compute[74278]: iSNS:
Oct 30 11:29:10 user nova-compute[74278]: No targets found.
Oct 30 11:29:10 user nova-compute[74278]: STATIC:
Oct 30 11:29:10 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a
Oct 30 11:29:10 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:29:10 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:29:10 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26
Oct 30 11:29:10 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:29:10 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:29:10 user nova-compute[74278]: FIRMWARE:
Oct 30 11:29:10 user nova-compute[74278]: No targets found.
Oct 30 11:29:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:29:10 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:29:10 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[91265e1e-75f0-49b3-945e-43a5ba4c3465]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f10434-b26d-4d66-9f19-d267ef65016c]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:29:10 user nova-compute[74278]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)
Oct 30 11:29:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 (non-flash)
Oct 30 11:29:10 user nova-compute[74278]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)
Oct 30 11:29:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff68c1cb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26'): ({'sdd'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Removing single pathed devices sdd {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67dc2a3-949f-499e-ad6a-028d44607f0f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8720b5-f3ba-4895-a8f6-43880d89eb4b]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Flushing IO for device /dev/sdd {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[18efd1e0-cae2-4c4b-bca0-4dd5122059b1]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6838fb-0852-4fb7-8176-578d51dca6b4]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] SCSI volumes sdd have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94e144e-6103-4285-8c6c-82670aff2755]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.115s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7134cc-65eb-4455-a134-e5d13587786f]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260]
Oct 30 11:29:10 user nova-compute[74278]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26, portal: 172.16.0.220,3260] successful.
Oct 30 11:29:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Calling os-brick to attach iSCSI Volume {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIBSQhpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:29:10 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c2f98ca-e3a9-4a1d-91e9-8840f5bf5c26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad65ed5e-62e0-4798-ba4f-095557fefa42]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] <== disconnect_volume: return (433ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:29:10 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Deleting instance files /opt/stack/data/nova/instances/30695565-3d1f-48b8-b85a-19f9e9a28196_del
Oct 30 11:29:10 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Deletion of /opt/stack/data/nova/instances/30695565-3d1f-48b8-b85a-19f9e9a28196_del complete
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.020s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:29:10 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:29:10 user nova-compute[74278]: INFO os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed33fd8e-2dc7-4ffc-9054-ceb06820a18b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 11:29:10 user nova-compute[74278]:  {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --interface default --op new {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e6d4d2-5080-4b67-8a26-e16189a719eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a] added\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a] added
Oct 30 11:29:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: INFO nova.compute.manager [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Took 2.05 seconds to destroy the instance on the hypervisor.
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a0b64e-3a3e-4445-96a3-bac32bc05383]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8ba11b-cec8-46ed-a1a8-5e46792c525c]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GIBSQhpK {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GIBSQhpK" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d3c1b7-c14b-4515-b67b-4a3f4354d803]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GIBSQhpK'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[6820a784-0db0-485b-8440-c5857e2975db]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f5c39f-641d-424c-824c-4809a5a6974d]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)
Oct 30 11:29:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)
Oct 30 11:29:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:29:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --login {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e818e3f-954d-404e-8c86-11329ad13daa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a, portal: 172.16.0.220,3260]
Oct 30 11:29:11 user nova-compute[74278]: Login to [iface: default, target: iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a, portal: 172.16.0.220,3260] successful.
Oct 30 11:29:11 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ebcb5e-0ff6-493b-b226-40c33134d228]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9319a4-d1c7-4099-a4d5-8f9edeeef04e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)
Oct 30 11:29:11 user nova-compute[74278]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a (non-flash)
Oct 30 11:29:11 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)
Oct 30 11:29:11 user nova-compute[74278]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a (non-flash)
Oct 30 11:29:11 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Connected to 172.16.0.220:3260 {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74278) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74278) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[35256e51-09af-430b-a00f-d9ef50eaed41]: (4, ('- - 0', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74278) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIBSQhpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74278) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:29:11 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Took 0.47 seconds to deallocate network for instance.
Oct 30 11:29:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-dc34cc87-8cb7-4a12-b3c3-66d016ec9ea5 req-937231ee-a198-47fc-a729-cb1691f9b9e5 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Received event network-vif-deleted-96d00d41-05f1-4e9c-8cea-b85bf7a79187 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:11 user nova-compute[74278]: INFO nova.compute.manager [req-dc34cc87-8cb7-4a12-b3c3-66d016ec9ea5 req-937231ee-a198-47fc-a729-cb1691f9b9e5 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Neutron deleted interface 96d00d41-05f1-4e9c-8cea-b85bf7a79187; detaching it from the instance and deleting it from the info cache
Oct 30 11:29:11 user nova-compute[74278]: DEBUG nova.network.neutron [req-dc34cc87-8cb7-4a12-b3c3-66d016ec9ea5 req-937231ee-a198-47fc-a729-cb1691f9b9e5 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-dc34cc87-8cb7-4a12-b3c3-66d016ec9ea5 req-937231ee-a198-47fc-a729-cb1691f9b9e5 service nova] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Detach interface failed, port_id=96d00d41-05f1-4e9c-8cea-b85bf7a79187, reason: Instance 30695565-3d1f-48b8-b85a-19f9e9a28196 could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:29:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-23a4cda8-42bb-46f0-8628-e64372b16f0e req-b5316f3d-b549-43f6-b97b-414bbcf6f783 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-23a4cda8-42bb-46f0-8628-e64372b16f0e req-b5316f3d-b549-43f6-b97b-414bbcf6f783 service nova] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-23a4cda8-42bb-46f0-8628-e64372b16f0e req-b5316f3d-b549-43f6-b97b-414bbcf6f783 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-23a4cda8-42bb-46f0-8628-e64372b16f0e req-b5316f3d-b549-43f6-b97b-414bbcf6f783 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-23a4cda8-42bb-46f0-8628-e64372b16f0e req-b5316f3d-b549-43f6-b97b-414bbcf6f783 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] No waiting events found dispatching network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:29:12 user nova-compute[74278]: WARNING nova.compute.manager [req-23a4cda8-42bb-46f0-8628-e64372b16f0e req-b5316f3d-b549-43f6-b97b-414bbcf6f783 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received unexpected event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 for instance with vm_state active and task_state rescuing.
Oct 30 11:29:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-23a4cda8-42bb-46f0-8628-e64372b16f0e req-b5316f3d-b549-43f6-b97b-414bbcf6f783 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-23a4cda8-42bb-46f0-8628-e64372b16f0e req-b5316f3d-b549-43f6-b97b-414bbcf6f783 service nova] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-23a4cda8-42bb-46f0-8628-e64372b16f0e req-b5316f3d-b549-43f6-b97b-414bbcf6f783 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-23a4cda8-42bb-46f0-8628-e64372b16f0e req-b5316f3d-b549-43f6-b97b-414bbcf6f783 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG nova.compute.manager [req-23a4cda8-42bb-46f0-8628-e64372b16f0e req-b5316f3d-b549-43f6-b97b-414bbcf6f783 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] No waiting events found dispatching network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:29:12 user nova-compute[74278]: WARNING nova.compute.manager [req-23a4cda8-42bb-46f0-8628-e64372b16f0e req-b5316f3d-b549-43f6-b97b-414bbcf6f783 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received unexpected event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 for instance with vm_state active and task_state rescuing.
Oct 30 11:29:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26434343964656232', 'path': '/dev/sdc'} {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434343964656232', 'path': '/dev/sdc'} {{(pid=74278) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG nova.objects.instance [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'flavor' on Instance uuid a3fca38e-c502-4111-8373-46491d806183 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 11:29:12 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:29:12 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:29:12 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:29:12 user nova-compute[74278]:   <serial>3526655e-ebe9-4341-a0b1-ee8881d42a4a</serial>
Oct 30 11:29:12 user nova-compute[74278]: </disk>
Oct 30 11:29:12 user nova-compute[74278]:  {{(pid=74278) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 11:29:12 user nova-compute[74278]: INFO nova.compute.manager [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] [instance: 30695565-3d1f-48b8-b85a-19f9e9a28196] Took 1.00 seconds to detach 1 volumes for instance.
Oct 30 11:29:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] No BDM found with device name vda, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74278) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] No VIF found with MAC fa:16:3e:99:ae:c5, not building metadata {{(pid=74278) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 11:29:12 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Deleted allocations for instance 30695565-3d1f-48b8-b85a-19f9e9a28196
Oct 30 11:29:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-edde8cc5-0291-4c85-9221-2152c25bb256 tempest-TestVolumeBootPattern-2008975673 tempest-TestVolumeBootPattern-2008975673-project-member] Lock "30695565-3d1f-48b8-b85a-19f9e9a28196" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.938s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-5072fbbb-e5a3-46cf-b7cb-e01690e159c7 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.339s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:13 user nova-compute[74278]: DEBUG nova.compute.manager [None req-34f98f42-0a12-4c7b-a35a-aa80811d01fc tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:29:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-2ad3b818-4197-42af-a00f-178dd2ff2121 req-c8b4fdd4-b4b0-41aa-9f99-96bf28ac5ddc service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-changed-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-2ad3b818-4197-42af-a00f-178dd2ff2121 req-c8b4fdd4-b4b0-41aa-9f99-96bf28ac5ddc service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Refreshing instance network info cache due to event network-changed-55a7d605-3793-4ff7-b0f7-6b375df45cf5. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:29:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2ad3b818-4197-42af-a00f-178dd2ff2121 req-c8b4fdd4-b4b0-41aa-9f99-96bf28ac5ddc service nova] Acquiring lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:29:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2ad3b818-4197-42af-a00f-178dd2ff2121 req-c8b4fdd4-b4b0-41aa-9f99-96bf28ac5ddc service nova] Acquired lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:29:14 user nova-compute[74278]: DEBUG nova.network.neutron [req-2ad3b818-4197-42af-a00f-178dd2ff2121 req-c8b4fdd4-b4b0-41aa-9f99-96bf28ac5ddc service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Refreshing network info cache for port 55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:29:15 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:29:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-2ad3b818-4197-42af-a00f-178dd2ff2121 req-c8b4fdd4-b4b0-41aa-9f99-96bf28ac5ddc service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Updated VIF entry in instance network info cache for port 55a7d605-3793-4ff7-b0f7-6b375df45cf5. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:29:15 user nova-compute[74278]: DEBUG nova.network.neutron [req-2ad3b818-4197-42af-a00f-178dd2ff2121 req-c8b4fdd4-b4b0-41aa-9f99-96bf28ac5ddc service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Updating instance_info_cache with network_info: [{"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:29:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2ad3b818-4197-42af-a00f-178dd2ff2121 req-c8b4fdd4-b4b0-41aa-9f99-96bf28ac5ddc service nova] Releasing lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:29:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-c58a833e-196d-4010-a6d1-e6e41a3255d4 req-b9ade7d0-d09f-4739-9761-6079f6bf584e service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-changed-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:17 user nova-compute[74278]: DEBUG nova.compute.manager [req-c58a833e-196d-4010-a6d1-e6e41a3255d4 req-b9ade7d0-d09f-4739-9761-6079f6bf584e service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Refreshing instance network info cache due to event network-changed-55a7d605-3793-4ff7-b0f7-6b375df45cf5. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:29:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c58a833e-196d-4010-a6d1-e6e41a3255d4 req-b9ade7d0-d09f-4739-9761-6079f6bf584e service nova] Acquiring lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:29:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c58a833e-196d-4010-a6d1-e6e41a3255d4 req-b9ade7d0-d09f-4739-9761-6079f6bf584e service nova] Acquired lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:29:17 user nova-compute[74278]: DEBUG nova.network.neutron [req-c58a833e-196d-4010-a6d1-e6e41a3255d4 req-b9ade7d0-d09f-4739-9761-6079f6bf584e service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Refreshing network info cache for port 55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:29:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:17 user nova-compute[74278]: INFO nova.compute.manager [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Rebooting instance
Oct 30 11:29:17 user nova-compute[74278]: DEBUG nova.network.neutron [req-c58a833e-196d-4010-a6d1-e6e41a3255d4 req-b9ade7d0-d09f-4739-9761-6079f6bf584e service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Updated VIF entry in instance network info cache for port 55a7d605-3793-4ff7-b0f7-6b375df45cf5. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:29:17 user nova-compute[74278]: DEBUG nova.network.neutron [req-c58a833e-196d-4010-a6d1-e6e41a3255d4 req-b9ade7d0-d09f-4739-9761-6079f6bf584e service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Updating instance_info_cache with network_info: [{"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:29:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c58a833e-196d-4010-a6d1-e6e41a3255d4 req-b9ade7d0-d09f-4739-9761-6079f6bf584e service nova] Releasing lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:29:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:29:17 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquired lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:29:17 user nova-compute[74278]: DEBUG nova.network.neutron [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:29:18 user nova-compute[74278]: DEBUG nova.network.neutron [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Updating instance_info_cache with network_info: [{"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:29:18 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Releasing lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:29:18 user nova-compute[74278]: DEBUG nova.compute.manager [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:29:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-c2772d4b-f615-445a-9095-0bbf37efcfde req-7b5aa24b-0ca2-46c4-b7d0-4d55ab2a5b0c service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-vif-unplugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c2772d4b-f615-445a-9095-0bbf37efcfde req-7b5aa24b-0ca2-46c4-b7d0-4d55ab2a5b0c service nova] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c2772d4b-f615-445a-9095-0bbf37efcfde req-7b5aa24b-0ca2-46c4-b7d0-4d55ab2a5b0c service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:20 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-c2772d4b-f615-445a-9095-0bbf37efcfde req-7b5aa24b-0ca2-46c4-b7d0-4d55ab2a5b0c service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:20 user nova-compute[74278]: DEBUG nova.compute.manager [req-c2772d4b-f615-445a-9095-0bbf37efcfde req-7b5aa24b-0ca2-46c4-b7d0-4d55ab2a5b0c service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] No waiting events found dispatching network-vif-unplugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:29:20 user nova-compute[74278]: WARNING nova.compute.manager [req-c2772d4b-f615-445a-9095-0bbf37efcfde req-7b5aa24b-0ca2-46c4-b7d0-4d55ab2a5b0c service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received unexpected event network-vif-unplugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 for instance with vm_state active and task_state reboot_started.
Oct 30 11:29:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:21 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Instance shutdown successfully.
Oct 30 11:29:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:22 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-ddda22c6-64f2-49d8-94ae-252a895b8dba req-6ab1cfbd-baac-4e86-94d0-982d615b8c6e service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ddda22c6-64f2-49d8-94ae-252a895b8dba req-6ab1cfbd-baac-4e86-94d0-982d615b8c6e service nova] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ddda22c6-64f2-49d8-94ae-252a895b8dba req-6ab1cfbd-baac-4e86-94d0-982d615b8c6e service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:22 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-ddda22c6-64f2-49d8-94ae-252a895b8dba req-6ab1cfbd-baac-4e86-94d0-982d615b8c6e service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:22 user nova-compute[74278]: DEBUG nova.compute.manager [req-ddda22c6-64f2-49d8-94ae-252a895b8dba req-6ab1cfbd-baac-4e86-94d0-982d615b8c6e service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] No waiting events found dispatching network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:29:22 user nova-compute[74278]: WARNING nova.compute.manager [req-ddda22c6-64f2-49d8-94ae-252a895b8dba req-6ab1cfbd-baac-4e86-94d0-982d615b8c6e service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received unexpected event network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 for instance with vm_state active and task_state reboot_started.
Oct 30 11:29:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:24 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a3fca38e-c502-4111-8373-46491d806183] Instance running successfully.
Oct 30 11:29:24 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Instance soft rebooted successfully.
Oct 30 11:29:24 user nova-compute[74278]: DEBUG nova.compute.manager [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:29:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-46ea393c-4255-4bd4-b8b8-06f6f9b3dbb3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.099s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:24 user nova-compute[74278]: DEBUG nova.compute.manager [req-7461742f-827a-4014-833c-727a0db6ef41 req-4ef96f59-e1fa-4bfc-a315-0f8d85ccd1c8 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7461742f-827a-4014-833c-727a0db6ef41 req-4ef96f59-e1fa-4bfc-a315-0f8d85ccd1c8 service nova] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7461742f-827a-4014-833c-727a0db6ef41 req-4ef96f59-e1fa-4bfc-a315-0f8d85ccd1c8 service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7461742f-827a-4014-833c-727a0db6ef41 req-4ef96f59-e1fa-4bfc-a315-0f8d85ccd1c8 service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:24 user nova-compute[74278]: DEBUG nova.compute.manager [req-7461742f-827a-4014-833c-727a0db6ef41 req-4ef96f59-e1fa-4bfc-a315-0f8d85ccd1c8 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] No waiting events found dispatching network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:29:24 user nova-compute[74278]: WARNING nova.compute.manager [req-7461742f-827a-4014-833c-727a0db6ef41 req-4ef96f59-e1fa-4bfc-a315-0f8d85ccd1c8 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received unexpected event network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 for instance with vm_state active and task_state None.
Oct 30 11:29:24 user nova-compute[74278]: DEBUG nova.compute.manager [req-7461742f-827a-4014-833c-727a0db6ef41 req-4ef96f59-e1fa-4bfc-a315-0f8d85ccd1c8 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:29:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7461742f-827a-4014-833c-727a0db6ef41 req-4ef96f59-e1fa-4bfc-a315-0f8d85ccd1c8 service nova] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:29:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7461742f-827a-4014-833c-727a0db6ef41 req-4ef96f59-e1fa-4bfc-a315-0f8d85ccd1c8 service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:29:24 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-7461742f-827a-4014-833c-727a0db6ef41 req-4ef96f59-e1fa-4bfc-a315-0f8d85ccd1c8 service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:29:24 user nova-compute[74278]: DEBUG nova.compute.manager [req-7461742f-827a-4014-833c-727a0db6ef41 req-4ef96f59-e1fa-4bfc-a315-0f8d85ccd1c8 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] No waiting events found dispatching network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:29:24 user nova-compute[74278]: WARNING nova.compute.manager [req-7461742f-827a-4014-833c-727a0db6ef41 req-4ef96f59-e1fa-4bfc-a315-0f8d85ccd1c8 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received unexpected event network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 for instance with vm_state active and task_state None.
Oct 30 11:29:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:50 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:29:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:52 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:29:52 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:29:53 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:29:53 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:29:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:29:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:55 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:29:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:29:56 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:29:57 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:29:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:29:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:29:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:29:57 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:29:57 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updating instance_info_cache with network_info: [{"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:29:57 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:29:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:30:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:01 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:30:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:30:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:30:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:30:01 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:30:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:30:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:30:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:30:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:30:01 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:30:01 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:30:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:30:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:30:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:30:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:30:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:30:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:30:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:30:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:30:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:30:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:30:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:30:03 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:30:03 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:30:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8508MB free_disk=24.73210906982422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a3fca38e-c502-4111-8373-46491d806183 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:30:03 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:30:04 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:30:04 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:30:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:30:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:30:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:30:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:30:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:30:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:30:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:30:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:30:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:30:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:30:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:30:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:30:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:30:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:30:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:30:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:30:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:30:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:30:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:53 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:30:53 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:30:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:30:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:30:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:30:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:30:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:30:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:30:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:30:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:55 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:30:56 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:30:57 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:30:58 user nova-compute[74278]: INFO nova.compute.manager [None req-b9da868a-0a48-4890-a55e-152d4939df7d tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Unrescuing
Oct 30 11:30:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b9da868a-0a48-4890-a55e-152d4939df7d tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:30:58 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b9da868a-0a48-4890-a55e-152d4939df7d tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquired lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:30:58 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b9da868a-0a48-4890-a55e-152d4939df7d tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Building network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-b9da868a-0a48-4890-a55e-152d4939df7d tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updating instance_info_cache with network_info: [{"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-b9da868a-0a48-4890-a55e-152d4939df7d tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Releasing lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG nova.objects.instance [None req-b9da868a-0a48-4890-a55e-152d4939df7d tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'flavor' on Instance uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-2c5c2443-069e-4121-bd7c-f4f2b9de5b7f req-928b8cbb-4e3c-4975-9dc1-7b0a4cf3ba00 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-unplugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2c5c2443-069e-4121-bd7c-f4f2b9de5b7f req-928b8cbb-4e3c-4975-9dc1-7b0a4cf3ba00 service nova] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2c5c2443-069e-4121-bd7c-f4f2b9de5b7f req-928b8cbb-4e3c-4975-9dc1-7b0a4cf3ba00 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-2c5c2443-069e-4121-bd7c-f4f2b9de5b7f req-928b8cbb-4e3c-4975-9dc1-7b0a4cf3ba00 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG nova.compute.manager [req-2c5c2443-069e-4121-bd7c-f4f2b9de5b7f req-928b8cbb-4e3c-4975-9dc1-7b0a4cf3ba00 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] No waiting events found dispatching network-vif-unplugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:30:59 user nova-compute[74278]: WARNING nova.compute.manager [req-2c5c2443-069e-4121-bd7c-f4f2b9de5b7f req-928b8cbb-4e3c-4975-9dc1-7b0a4cf3ba00 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received unexpected event network-vif-unplugged-bee51f46-936e-44f3-bc9d-60bc94025b37 for instance with vm_state rescued and task_state unrescuing.
Oct 30 11:30:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: a3fca38e-c502-4111-8373-46491d806183] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:30:59 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Instance destroyed successfully.
Oct 30 11:30:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: a3fca38e-c502-4111-8373-46491d806183] Updating instance_info_cache with network_info: [{"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:30:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: a3fca38e-c502-4111-8373-46491d806183] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:31:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] No waiting events found dispatching network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:31:01 user nova-compute[74278]: WARNING nova.compute.manager [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received unexpected event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 for instance with vm_state rescued and task_state unrescuing.
Oct 30 11:31:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] No waiting events found dispatching network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:31:01 user nova-compute[74278]: WARNING nova.compute.manager [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received unexpected event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 for instance with vm_state rescued and task_state unrescuing.
Oct 30 11:31:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:31:01 user nova-compute[74278]: DEBUG nova.compute.manager [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] No waiting events found dispatching network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:31:01 user nova-compute[74278]: WARNING nova.compute.manager [req-e518fb5f-34ca-43dc-93f8-61da75e7a07d req-aa93c9e4-383a-499b-a982-1dab54b1f484 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received unexpected event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 for instance with vm_state rescued and task_state unrescuing.
Oct 30 11:31:02 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:31:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:31:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:31:02 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:31:02 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:31:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:02 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:31:02 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:03 user nova-compute[74278]: DEBUG nova.compute.manager [None req-b9da868a-0a48-4890-a55e-152d4939df7d tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Checking state {{(pid=74278) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 11:31:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:31:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:04 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:31:04 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:31:04 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8652MB free_disk=24.729637145996094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:31:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:31:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:31:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:31:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:31:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:31:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a3fca38e-c502-4111-8373-46491d806183 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:31:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:31:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:31:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:05 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:31:05 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:31:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:31:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:31:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-80faab4f-2b37-41b1-9d32-4c884a89e457 req-eb94d623-87e7-43cd-a031-eeab6227ecd4 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-changed-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:31:09 user nova-compute[74278]: DEBUG nova.compute.manager [req-80faab4f-2b37-41b1-9d32-4c884a89e457 req-eb94d623-87e7-43cd-a031-eeab6227ecd4 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Refreshing instance network info cache due to event network-changed-55a7d605-3793-4ff7-b0f7-6b375df45cf5. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:31:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-80faab4f-2b37-41b1-9d32-4c884a89e457 req-eb94d623-87e7-43cd-a031-eeab6227ecd4 service nova] Acquiring lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:31:09 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-80faab4f-2b37-41b1-9d32-4c884a89e457 req-eb94d623-87e7-43cd-a031-eeab6227ecd4 service nova] Acquired lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:31:09 user nova-compute[74278]: DEBUG nova.network.neutron [req-80faab4f-2b37-41b1-9d32-4c884a89e457 req-eb94d623-87e7-43cd-a031-eeab6227ecd4 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Refreshing network info cache for port 55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:31:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:10 user nova-compute[74278]: DEBUG nova.network.neutron [req-80faab4f-2b37-41b1-9d32-4c884a89e457 req-eb94d623-87e7-43cd-a031-eeab6227ecd4 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Updated VIF entry in instance network info cache for port 55a7d605-3793-4ff7-b0f7-6b375df45cf5. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:31:10 user nova-compute[74278]: DEBUG nova.network.neutron [req-80faab4f-2b37-41b1-9d32-4c884a89e457 req-eb94d623-87e7-43cd-a031-eeab6227ecd4 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Updating instance_info_cache with network_info: [{"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:31:10 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-80faab4f-2b37-41b1-9d32-4c884a89e457 req-eb94d623-87e7-43cd-a031-eeab6227ecd4 service nova] Releasing lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:31:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-bceee852-3df0-4433-8d50-918df5782036 req-b03c6ce8-2b53-4e84-bdc4-9391ec6e4eb7 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-changed-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:31:11 user nova-compute[74278]: DEBUG nova.compute.manager [req-bceee852-3df0-4433-8d50-918df5782036 req-b03c6ce8-2b53-4e84-bdc4-9391ec6e4eb7 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Refreshing instance network info cache due to event network-changed-55a7d605-3793-4ff7-b0f7-6b375df45cf5. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:31:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bceee852-3df0-4433-8d50-918df5782036 req-b03c6ce8-2b53-4e84-bdc4-9391ec6e4eb7 service nova] Acquiring lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:31:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bceee852-3df0-4433-8d50-918df5782036 req-b03c6ce8-2b53-4e84-bdc4-9391ec6e4eb7 service nova] Acquired lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:31:11 user nova-compute[74278]: DEBUG nova.network.neutron [req-bceee852-3df0-4433-8d50-918df5782036 req-b03c6ce8-2b53-4e84-bdc4-9391ec6e4eb7 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Refreshing network info cache for port 55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:31:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:31:11 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:31:11 user nova-compute[74278]: INFO nova.compute.manager [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Detaching volume 3526655e-ebe9-4341-a0b1-ee8881d42a4a
Oct 30 11:31:11 user nova-compute[74278]: INFO nova.virt.block_device [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Attempting to driver detach volume 3526655e-ebe9-4341-a0b1-ee8881d42a4a from mountpoint /dev/vdb
Oct 30 11:31:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Attempting to detach device vdb from instance a3fca38e-c502-4111-8373-46491d806183 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:31:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:31:11 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:31:11 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:31:11 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:31:11 user nova-compute[74278]:   <serial>3526655e-ebe9-4341-a0b1-ee8881d42a4a</serial>
Oct 30 11:31:11 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:31:11 user nova-compute[74278]: </disk>
Oct 30 11:31:11 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:31:11 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Successfully detached device vdb from instance a3fca38e-c502-4111-8373-46491d806183 from the persistent domain config.
Oct 30 11:31:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3fca38e-c502-4111-8373-46491d806183 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:31:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:31:11 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:31:11 user nova-compute[74278]:   <source dev="/dev/sdc"/>
Oct 30 11:31:11 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:31:11 user nova-compute[74278]:   <serial>3526655e-ebe9-4341-a0b1-ee8881d42a4a</serial>
Oct 30 11:31:11 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:31:11 user nova-compute[74278]: </disk>
Oct 30 11:31:11 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:31:12 user nova-compute[74278]: DEBUG nova.network.neutron [req-bceee852-3df0-4433-8d50-918df5782036 req-b03c6ce8-2b53-4e84-bdc4-9391ec6e4eb7 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Updated VIF entry in instance network info cache for port 55a7d605-3793-4ff7-b0f7-6b375df45cf5. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:31:12 user nova-compute[74278]: DEBUG nova.network.neutron [req-bceee852-3df0-4433-8d50-918df5782036 req-b03c6ce8-2b53-4e84-bdc4-9391ec6e4eb7 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Updating instance_info_cache with network_info: [{"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:31:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bceee852-3df0-4433-8d50-918df5782036 req-b03c6ce8-2b53-4e84-bdc4-9391ec6e4eb7 service nova] Releasing lock "refresh_cache-a3fca38e-c502-4111-8373-46491d806183" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:31:12 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3fca38e-c502-4111-8373-46491d806183 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:31:15 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:18 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:31:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:31:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:31:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:31:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:31:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:20 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:25 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:30 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:32 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a3fca38e-c502-4111-8373-46491d806183 is timed out.
Oct 30 11:31:32 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Successfully detached device vdb from instance a3fca38e-c502-4111-8373-46491d806183 from the live domain config.
Oct 30 11:31:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIBSQhpK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:31:32 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b968c7b3-e6a7-4ef8-9dd2-99bae5602da5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:31:32 user nova-compute[74278]: No targets found.
Oct 30 11:31:32 user nova-compute[74278]: iSNS:
Oct 30 11:31:32 user nova-compute[74278]: No targets found.
Oct 30 11:31:32 user nova-compute[74278]: STATIC:
Oct 30 11:31:32 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a
Oct 30 11:31:32 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:31:32 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:31:32 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a
Oct 30 11:31:32 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:31:32 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:31:32 user nova-compute[74278]: FIRMWARE:
Oct 30 11:31:32 user nova-compute[74278]: No targets found.
Oct 30 11:31:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:31:32 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:31:32 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[71357246-f8ea-40a6-8294-fb9df7f37484]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7082de9-8515-419c-852a-63a7995ea5b0]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)
Oct 30 11:31:32 user nova-compute[74278]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a (non-flash)
Oct 30 11:31:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)
Oct 30 11:31:32 user nova-compute[74278]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a (non-flash)
Oct 30 11:31:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac7cc310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a'): ({'sdc'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Removing single pathed devices sdc {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[62261524-e361-46fe-aa03-82a15e6a062c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc55255-5129-43fd-8577-c98f566864f9]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Flushing IO for device /dev/sdc {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2b5009-265f-40f0-b151-3f1effede366]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[248543d4-693e-4b74-8023-b7ffce31a972]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] SCSI volumes sdc have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[74257fc2-b3b7-44ca-9aac-54aea8b31450]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b06989-74f0-498c-9c44-522f5e671459]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a, portal: 172.16.0.220,3260]
Oct 30 11:31:32 user nova-compute[74278]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a, portal: 172.16.0.220,3260] successful.
Oct 30 11:31:32 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3526655e-ebe9-4341-a0b1-ee8881d42a4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f0e0e5-a3e7-4539-8179-928925960542]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] <== disconnect_volume: return (319ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:31:32 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:31:33 user nova-compute[74278]: DEBUG nova.objects.instance [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'flavor' on Instance uuid a3fca38e-c502-4111-8373-46491d806183 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:31:33 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-8fa683f6-91b3-4fd6-885d-c7cdbc9dcc6e tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.934s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:31:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:35 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:45 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:31:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:31:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:31:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:31:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:31:45 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:50 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:31:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:31:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:31:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:31:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:31:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:31:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:31:55 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:31:55 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:31:55 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:31:55 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:31:55 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:31:56 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:31:57 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:31:59 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:31:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:31:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 11:31:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:31:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:31:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:31:59 user nova-compute[74278]: DEBUG nova.objects.instance [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lazy-loading 'info_cache' on Instance uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:31:59 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updating instance_info_cache with network_info: [{"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:31:59 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:31:59 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:32:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:32:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:32:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:32:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:32:00 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:03 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:32:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:32:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:32:03 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:32:03 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:32:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:32:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:32:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:32:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:32:03 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74278) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 11:32:03 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:32:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:32:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:32:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:32:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:32:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:32:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:32:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:32:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:32:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:32:04 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:32:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:32:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:32:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:32:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:32:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:32:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:05 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:32:05 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:32:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=24.72835922241211GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:32:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:32:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance a3fca38e-c502-4111-8373-46491d806183 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing inventories for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating ProviderTree inventory for provider ce405684-67ab-45d9-bc83-6af4903bfb15 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating inventory in ProviderTree for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing aggregate associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, aggregates: None {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing trait associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:32:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:32:10 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:32:10 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74278) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 11:32:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:32:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:32:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:32:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:32:10 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:32:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:32:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:32:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:32:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:32:12 user nova-compute[74278]: INFO nova.compute.manager [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Terminating instance
Oct 30 11:32:12 user nova-compute[74278]: DEBUG nova.compute.manager [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:32:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:12 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-6dffd25b-9945-4fb8-8f2a-accbaf68d3ca req-f3d2f33d-01e0-4e62-832e-6672b11c1774 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-vif-unplugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6dffd25b-9945-4fb8-8f2a-accbaf68d3ca req-f3d2f33d-01e0-4e62-832e-6672b11c1774 service nova] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6dffd25b-9945-4fb8-8f2a-accbaf68d3ca req-f3d2f33d-01e0-4e62-832e-6672b11c1774 service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-6dffd25b-9945-4fb8-8f2a-accbaf68d3ca req-f3d2f33d-01e0-4e62-832e-6672b11c1774 service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-6dffd25b-9945-4fb8-8f2a-accbaf68d3ca req-f3d2f33d-01e0-4e62-832e-6672b11c1774 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] No waiting events found dispatching network-vif-unplugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG nova.compute.manager [req-6dffd25b-9945-4fb8-8f2a-accbaf68d3ca req-f3d2f33d-01e0-4e62-832e-6672b11c1774 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-vif-unplugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: a3fca38e-c502-4111-8373-46491d806183] Instance destroyed successfully.
Oct 30 11:32:13 user nova-compute[74278]: DEBUG nova.objects.instance [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lazy-loading 'resources' on Instance uuid a3fca38e-c502-4111-8373-46491d806183 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:26:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1497588327',display_name='tempest-TestMinimumBasicScenario-server-1497588327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1497588327',id=52,image_ref='1b0d2fb4-d151-4d7d-b7da-cb55d40aa847',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7j5x50HthJ4tyoc7JJ3s7oGpnBbgA5knRQGb36CewRyC6qEpxEtQkac22R1UbVt+x+6z70ZZkW2kiCarFPYBwrFhE6uXWI6Z9Bkx04DVvfYxEsNbFsSLJqYorY7JI6Og==',key_name='tempest-TestMinimumBasicScenario-1392120610',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:27:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbe8ef99a57b49049a3266b974ba661b',ramdisk_id='',reservation_id='r-tn6iiyhu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1b0d2fb4-d151-4d7d-b7da-cb55d40aa847',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-274954723',owner_user_name='tempest-TestMinimumBasicScenario-274954723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:29:25Z,user_data=None,user_id='03fb7307a64e4bcfb24ad4d337e12688',uuid=a3fca38e-c502-4111-8373-46491d806183,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converting VIF {"id": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "address": "fa:16:3e:99:ae:c5", "network": {"id": "8ed74a11-892b-4376-beb5-ce29c50c82e5", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1400019879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe8ef99a57b49049a3266b974ba661b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55a7d605-37", "ovs_interfaceid": "55a7d605-3793-4ff7-b0f7-6b375df45cf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:ae:c5,bridge_name='br-int',has_traffic_filtering=True,id=55a7d605-3793-4ff7-b0f7-6b375df45cf5,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a7d605-37') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG os_vif [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:ae:c5,bridge_name='br-int',has_traffic_filtering=True,id=55a7d605-3793-4ff7-b0f7-6b375df45cf5,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a7d605-37') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55a7d605-37, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9127b4b9-21bc-4daa-ab91-4d364bfa62e4) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:13 user nova-compute[74278]: INFO os_vif [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:ae:c5,bridge_name='br-int',has_traffic_filtering=True,id=55a7d605-3793-4ff7-b0f7-6b375df45cf5,network=Network(8ed74a11-892b-4376-beb5-ce29c50c82e5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55a7d605-37')
Oct 30 11:32:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Deleting instance files /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183_del
Oct 30 11:32:13 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Deletion of /opt/stack/data/nova/instances/a3fca38e-c502-4111-8373-46491d806183_del complete
Oct 30 11:32:13 user nova-compute[74278]: INFO nova.compute.manager [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] [instance: a3fca38e-c502-4111-8373-46491d806183] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 30 11:32:13 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: a3fca38e-c502-4111-8373-46491d806183] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:32:13 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: a3fca38e-c502-4111-8373-46491d806183] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:32:14 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: a3fca38e-c502-4111-8373-46491d806183] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:32:14 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: a3fca38e-c502-4111-8373-46491d806183] Took 0.40 seconds to deallocate network for instance.
Oct 30 11:32:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:32:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:32:14 user nova-compute[74278]: DEBUG nova.compute.manager [req-e706203b-6ad7-4453-8815-a3f0e031755b req-f6180625-4daf-4301-a5bd-e885de3ca5de service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-vif-deleted-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:32:14 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:32:14 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:32:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:32:14 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Deleted allocations for instance a3fca38e-c502-4111-8373-46491d806183
Oct 30 11:32:14 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-f131a72a-05e8-412c-bc08-222a1d2da8a3 tempest-TestMinimumBasicScenario-274954723 tempest-TestMinimumBasicScenario-274954723-project-member] Lock "a3fca38e-c502-4111-8373-46491d806183" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.686s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:32:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-52a7e8c0-89e7-4c16-ace0-5cc7ad43a409 req-905d6d27-609a-4910-8999-2adc730639d2 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received event network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:32:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-52a7e8c0-89e7-4c16-ace0-5cc7ad43a409 req-905d6d27-609a-4910-8999-2adc730639d2 service nova] Acquiring lock "a3fca38e-c502-4111-8373-46491d806183-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:32:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-52a7e8c0-89e7-4c16-ace0-5cc7ad43a409 req-905d6d27-609a-4910-8999-2adc730639d2 service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:32:15 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-52a7e8c0-89e7-4c16-ace0-5cc7ad43a409 req-905d6d27-609a-4910-8999-2adc730639d2 service nova] Lock "a3fca38e-c502-4111-8373-46491d806183-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:32:15 user nova-compute[74278]: DEBUG nova.compute.manager [req-52a7e8c0-89e7-4c16-ace0-5cc7ad43a409 req-905d6d27-609a-4910-8999-2adc730639d2 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] No waiting events found dispatching network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:32:15 user nova-compute[74278]: WARNING nova.compute.manager [req-52a7e8c0-89e7-4c16-ace0-5cc7ad43a409 req-905d6d27-609a-4910-8999-2adc730639d2 service nova] [instance: a3fca38e-c502-4111-8373-46491d806183] Received unexpected event network-vif-plugged-55a7d605-3793-4ff7-b0f7-6b375df45cf5 for instance with vm_state deleted and task_state None.
Oct 30 11:32:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:19 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:32:19 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 11:32:19 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] There are 0 instances to clean {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 11:32:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:32:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:32:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:32:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:32:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:32:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:32:43 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:32:48 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:32:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-0b8bb792-8f66-43c4-9839-0c8692cd8f9a req-075df856-de5f-411c-a7cc-3277aeba91ae service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-changed-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:32:49 user nova-compute[74278]: DEBUG nova.compute.manager [req-0b8bb792-8f66-43c4-9839-0c8692cd8f9a req-075df856-de5f-411c-a7cc-3277aeba91ae service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Refreshing instance network info cache due to event network-changed-bee51f46-936e-44f3-bc9d-60bc94025b37. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:32:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0b8bb792-8f66-43c4-9839-0c8692cd8f9a req-075df856-de5f-411c-a7cc-3277aeba91ae service nova] Acquiring lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:32:49 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0b8bb792-8f66-43c4-9839-0c8692cd8f9a req-075df856-de5f-411c-a7cc-3277aeba91ae service nova] Acquired lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:32:49 user nova-compute[74278]: DEBUG nova.network.neutron [req-0b8bb792-8f66-43c4-9839-0c8692cd8f9a req-075df856-de5f-411c-a7cc-3277aeba91ae service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Refreshing network info cache for port bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:32:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:32:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:32:50 user nova-compute[74278]: DEBUG nova.network.neutron [req-0b8bb792-8f66-43c4-9839-0c8692cd8f9a req-075df856-de5f-411c-a7cc-3277aeba91ae service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updated VIF entry in instance network info cache for port bee51f46-936e-44f3-bc9d-60bc94025b37. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:32:50 user nova-compute[74278]: DEBUG nova.network.neutron [req-0b8bb792-8f66-43c4-9839-0c8692cd8f9a req-075df856-de5f-411c-a7cc-3277aeba91ae service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updating instance_info_cache with network_info: [{"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:32:50 user nova-compute[74278]: INFO nova.compute.manager [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Detaching volume 92e356d4-121e-435e-b065-10e9c88a0c1a
Oct 30 11:32:50 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0b8bb792-8f66-43c4-9839-0c8692cd8f9a req-075df856-de5f-411c-a7cc-3277aeba91ae service nova] Releasing lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:32:50 user nova-compute[74278]: INFO nova.virt.block_device [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Attempting to driver detach volume 92e356d4-121e-435e-b065-10e9c88a0c1a from mountpoint /dev/vdb
Oct 30 11:32:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Attempting to detach device vdb from instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 from the persistent domain config. {{(pid=74278) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 11:32:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:32:50 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:32:50 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:32:50 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:32:50 user nova-compute[74278]:   <serial>92e356d4-121e-435e-b065-10e9c88a0c1a</serial>
Oct 30 11:32:50 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:32:50 user nova-compute[74278]: </disk>
Oct 30 11:32:50 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:32:50 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Successfully detached device vdb from instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 from the persistent domain config.
Oct 30 11:32:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 from the live domain config. {{(pid=74278) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 11:32:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.guest [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 11:32:50 user nova-compute[74278]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 11:32:50 user nova-compute[74278]:   <source dev="/dev/sdb"/>
Oct 30 11:32:50 user nova-compute[74278]:   <target dev="vdb" bus="virtio"/>
Oct 30 11:32:50 user nova-compute[74278]:   <serial>92e356d4-121e-435e-b065-10e9c88a0c1a</serial>
Oct 30 11:32:50 user nova-compute[74278]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 11:32:50 user nova-compute[74278]: </disk>
Oct 30 11:32:50 user nova-compute[74278]:  {{(pid=74278) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 11:32:50 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:32:50 user nova-compute[74278]: DEBUG nova.virt.libvirt.driver [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 11:32:50 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:51 user nova-compute[74278]: DEBUG nova.compute.manager [req-01a30494-d0d4-412d-b011-d22731a93fd8 req-6d72da41-61fa-4e87-a217-1ae2ff92eb6d service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-changed-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:32:51 user nova-compute[74278]: DEBUG nova.compute.manager [req-01a30494-d0d4-412d-b011-d22731a93fd8 req-6d72da41-61fa-4e87-a217-1ae2ff92eb6d service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Refreshing instance network info cache due to event network-changed-bee51f46-936e-44f3-bc9d-60bc94025b37. {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 11:32:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-01a30494-d0d4-412d-b011-d22731a93fd8 req-6d72da41-61fa-4e87-a217-1ae2ff92eb6d service nova] Acquiring lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:32:51 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-01a30494-d0d4-412d-b011-d22731a93fd8 req-6d72da41-61fa-4e87-a217-1ae2ff92eb6d service nova] Acquired lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:32:51 user nova-compute[74278]: DEBUG nova.network.neutron [req-01a30494-d0d4-412d-b011-d22731a93fd8 req-6d72da41-61fa-4e87-a217-1ae2ff92eb6d service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Refreshing network info cache for port bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 11:32:52 user nova-compute[74278]: DEBUG nova.network.neutron [req-01a30494-d0d4-412d-b011-d22731a93fd8 req-6d72da41-61fa-4e87-a217-1ae2ff92eb6d service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updated VIF entry in instance network info cache for port bee51f46-936e-44f3-bc9d-60bc94025b37. {{(pid=74278) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 11:32:52 user nova-compute[74278]: DEBUG nova.network.neutron [req-01a30494-d0d4-412d-b011-d22731a93fd8 req-6d72da41-61fa-4e87-a217-1ae2ff92eb6d service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updating instance_info_cache with network_info: [{"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:32:52 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-01a30494-d0d4-412d-b011-d22731a93fd8 req-6d72da41-61fa-4e87-a217-1ae2ff92eb6d service nova] Releasing lock "refresh_cache-0a11cbf9-03bd-4f17-9fc8-41e095780fe9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:32:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:55 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:32:55 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:32:56 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:32:56 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:32:56 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:32:57 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:32:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:32:59 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:33:00 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:33:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:33:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:33:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:33:00 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:33:00 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updating instance_info_cache with network_info: [{"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:33:00 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-85e83e56-3a30-4c75-b480-b1d298352888" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:33:00 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:33:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:05 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:05 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:33:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:33:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:33:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:33:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:33:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:07 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:33:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:33:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=24.79519271850586GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:33:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:33:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:33:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:33:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:33:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:33:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:33:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:33:07 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:33:07 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:33:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:33:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:33:08 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:10 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 is timed out.
Oct 30 11:33:10 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Successfully detached device vdb from instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 from the live domain config.
Oct 30 11:33:10 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] calling os-brick to detach iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff68c700340>, {'target_iqn': 'iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmprgZsA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 11:33:10 user nova-compute[74278]: WARNING os_brick.initiator.connectors.base [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[943768aa-5014-4637-8104-a75e988413da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 11:33:10 user nova-compute[74278]: No targets found.
Oct 30 11:33:10 user nova-compute[74278]: iSNS:
Oct 30 11:33:10 user nova-compute[74278]: No targets found.
Oct 30 11:33:10 user nova-compute[74278]: STATIC:
Oct 30 11:33:10 user nova-compute[74278]: Target: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a
Oct 30 11:33:10 user nova-compute[74278]:         Portal: 172.16.0.220:3260,-1
Oct 30 11:33:10 user nova-compute[74278]:                 Iface Name: default
Oct 30 11:33:10 user nova-compute[74278]: FIRMWARE:
Oct 30 11:33:10 user nova-compute[74278]: No targets found.
Oct 30 11:33:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 11:33:10 user nova-compute[74278]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 11:33:10 user nova-compute[74278]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74278) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a', 0)] {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[a142c530-bd5c-4a58-ad18-492cd545ebc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2399181-6595-490f-ba1f-7329da245d9a]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)
Oct 30 11:33:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a (non-flash)
Oct 30 11:33:10 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff6ac2e3d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a'): ({'sdb'}, set())}) {{(pid=74278) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Removing single pathed devices sdb {{(pid=74278) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[41149372-4779-4c6e-8ad0-ca510ca07af3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[999dd668-4df5-40c6-a009-263f886eb054]: (4, ('ok\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Flushing IO for device /dev/sdb {{(pid=74278) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f47091-96ee-43c7-a6b0-233cd4f8c9c3]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74278) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac243282-b03c-4e55-850e-ee005f47bc70]: (4, ('1', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.linuxscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] SCSI volumes sdb have been removed. {{(pid=74278) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a')] {{(pid=74278) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[706564a7-f001-4295-bb0c-4d2e52b0a192]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:33:10 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --logout {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.206s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[92798e7e-0dc1-4d48-a9c0-92ed0eb755ad]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:33:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a, portal: 172.16.0.220,3260]
Oct 30 11:33:11 user nova-compute[74278]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a, portal: 172.16.0.220,3260] successful.
Oct 30 11:33:11 user nova-compute[74278]:  stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:33:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op delete {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:33:11 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92e356d4-121e-435e-b065-10e9c88a0c1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85487) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:33:11 user nova-compute[74278]: DEBUG oslo.privsep.daemon [-] privsep: reply[06823c23-5320-495b-b8eb-4f905e2f4057]: (4, ('', '')) {{(pid=85487) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 11:33:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74278) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 11:33:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.base [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.459s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 11:33:11 user nova-compute[74278]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] <== disconnect_volume: return (461ms) None {{(pid=74278) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 11:33:11 user nova-compute[74278]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Disconnected iSCSI Volume {{(pid=74278) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 11:33:12 user nova-compute[74278]: DEBUG nova.objects.instance [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'flavor' on Instance uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:33:12 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-98b0d70a-d2dd-4052-8d2a-720fb44e571b tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.957s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:33:13 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:18 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:33:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:33:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:33:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:33:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:33:18 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:23 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:33:28 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:33 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:33:38 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:33:40 user nova-compute[74278]: INFO nova.compute.manager [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Terminating instance
Oct 30 11:33:40 user nova-compute[74278]: DEBUG nova.compute.manager [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG nova.compute.manager [req-0db336e0-b082-4f53-9c65-361ccc606177 req-d31a1f03-1e96-4de3-9745-456a8ad21299 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-unplugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0db336e0-b082-4f53-9c65-361ccc606177 req-d31a1f03-1e96-4de3-9745-456a8ad21299 service nova] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0db336e0-b082-4f53-9c65-361ccc606177 req-d31a1f03-1e96-4de3-9745-456a8ad21299 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-0db336e0-b082-4f53-9c65-361ccc606177 req-d31a1f03-1e96-4de3-9745-456a8ad21299 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG nova.compute.manager [req-0db336e0-b082-4f53-9c65-361ccc606177 req-d31a1f03-1e96-4de3-9745-456a8ad21299 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] No waiting events found dispatching network-vif-unplugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:33:40 user nova-compute[74278]: DEBUG nova.compute.manager [req-0db336e0-b082-4f53-9c65-361ccc606177 req-d31a1f03-1e96-4de3-9745-456a8ad21299 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-unplugged-bee51f46-936e-44f3-bc9d-60bc94025b37 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:33:41 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Instance destroyed successfully.
Oct 30 11:33:41 user nova-compute[74278]: DEBUG nova.objects.instance [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'resources' on Instance uuid 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-511782841',display_name='tempest-ServerRescueNegativeTestJSON-server-511782841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-511782841',id=51,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAqL4y+XnS+gly0VAbSOSvcpyqUTX/mfD36u6nFufbYk5xGRXwyztWf2UqC7vTAFoG2vnZLg/CBBePeDiB60SF9Mz+V2MwUf8wzawoByo6mCN97zQ65zjHEq5uT1I/19A==',key_name='tempest-keypair-1125188050',keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:29:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a881207e0d4a4314a979e3af56cf2f95',ramdisk_id='',reservation_id='r-3id3wdaw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2065673492',owner_user_name='tempest-ServerRescueNegativeTestJSON-2065673492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:31:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ad932a451724349a5c40964d7e75157',uuid=0a11cbf9-03bd-4f17-9fc8-41e095780fe9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converting VIF {"id": "bee51f46-936e-44f3-bc9d-60bc94025b37", "address": "fa:16:3e:fa:b4:2e", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbee51f46-93", "ovs_interfaceid": "bee51f46-936e-44f3-bc9d-60bc94025b37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:b4:2e,bridge_name='br-int',has_traffic_filtering=True,id=bee51f46-936e-44f3-bc9d-60bc94025b37,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee51f46-93') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG os_vif [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:b4:2e,bridge_name='br-int',has_traffic_filtering=True,id=bee51f46-936e-44f3-bc9d-60bc94025b37,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee51f46-93') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbee51f46-93, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d02ad26f-9478-45e1-a723-eb222d40bbd7) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:41 user nova-compute[74278]: INFO os_vif [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:b4:2e,bridge_name='br-int',has_traffic_filtering=True,id=bee51f46-936e-44f3-bc9d-60bc94025b37,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbee51f46-93')
Oct 30 11:33:41 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Deleting instance files /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9_del
Oct 30 11:33:41 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Deletion of /opt/stack/data/nova/instances/0a11cbf9-03bd-4f17-9fc8-41e095780fe9_del complete
Oct 30 11:33:41 user nova-compute[74278]: INFO nova.compute.manager [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 30 11:33:41 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:33:41 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:33:42 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:33:42 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Took 0.86 seconds to deallocate network for instance.
Oct 30 11:33:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-d4ba5b14-6ab5-45ad-8a87-4542d8e5b533 req-2c39f249-265c-4792-82e7-138eefe519dd service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-deleted-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:33:42 user nova-compute[74278]: INFO nova.compute.manager [req-d4ba5b14-6ab5-45ad-8a87-4542d8e5b533 req-2c39f249-265c-4792-82e7-138eefe519dd service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Neutron deleted interface bee51f46-936e-44f3-bc9d-60bc94025b37; detaching it from the instance and deleting it from the info cache
Oct 30 11:33:42 user nova-compute[74278]: DEBUG nova.network.neutron [req-d4ba5b14-6ab5-45ad-8a87-4542d8e5b533 req-2c39f249-265c-4792-82e7-138eefe519dd service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:33:42 user nova-compute[74278]: DEBUG nova.compute.manager [req-d4ba5b14-6ab5-45ad-8a87-4542d8e5b533 req-2c39f249-265c-4792-82e7-138eefe519dd service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Detach interface failed, port_id=bee51f46-936e-44f3-bc9d-60bc94025b37, reason: Instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9 could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:33:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:33:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:33:42 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:33:42 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:33:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:33:42 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Deleted allocations for instance 0a11cbf9-03bd-4f17-9fc8-41e095780fe9
Oct 30 11:33:42 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-4467d6f3-986b-4c0a-b5b8-7ccb31419e05 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.115s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:33:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-b99295df-15c7-4bfd-a69f-3146180d66a0 req-6e892aa3-082b-48d1-b52c-3f9e7eee0394 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:33:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b99295df-15c7-4bfd-a69f-3146180d66a0 req-6e892aa3-082b-48d1-b52c-3f9e7eee0394 service nova] Acquiring lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:33:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b99295df-15c7-4bfd-a69f-3146180d66a0 req-6e892aa3-082b-48d1-b52c-3f9e7eee0394 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:33:43 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-b99295df-15c7-4bfd-a69f-3146180d66a0 req-6e892aa3-082b-48d1-b52c-3f9e7eee0394 service nova] Lock "0a11cbf9-03bd-4f17-9fc8-41e095780fe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:33:43 user nova-compute[74278]: DEBUG nova.compute.manager [req-b99295df-15c7-4bfd-a69f-3146180d66a0 req-6e892aa3-082b-48d1-b52c-3f9e7eee0394 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] No waiting events found dispatching network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:33:43 user nova-compute[74278]: WARNING nova.compute.manager [req-b99295df-15c7-4bfd-a69f-3146180d66a0 req-6e892aa3-082b-48d1-b52c-3f9e7eee0394 service nova] [instance: 0a11cbf9-03bd-4f17-9fc8-41e095780fe9] Received unexpected event network-vif-plugged-bee51f46-936e-44f3-bc9d-60bc94025b37 for instance with vm_state deleted and task_state None.
Oct 30 11:33:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:33:52 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:33:55 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:33:55 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:33:56 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:33:57 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:33:58 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:33:58 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:33:59 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:33:59 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:34:01 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:02 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:34:02 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:34:02 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Didn't find any instances for network info cache update. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 11:34:05 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:34:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:34:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:34:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:34:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:34:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:34:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:34:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:34:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:34:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:34:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:34:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:34:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:34:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:34:06 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:34:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:34:06 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:34:06 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:34:06 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:34:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=24.82170867919922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:34:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:34:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:34:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:34:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 85e83e56-3a30-4c75-b480-b1d298352888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:34:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:34:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:34:07 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:34:07 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:34:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:34:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:34:11 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:34:16 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:21 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:26 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:34:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:31 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:41 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:34:46 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:51 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "85e83e56-3a30-4c75-b480-b1d298352888" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "85e83e56-3a30-4c75-b480-b1d298352888" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "85e83e56-3a30-4c75-b480-b1d298352888-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:34:53 user nova-compute[74278]: INFO nova.compute.manager [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Terminating instance
Oct 30 11:34:53 user nova-compute[74278]: DEBUG nova.compute.manager [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-83a686e3-4f49-43f2-9f56-960fe8396862 req-e4b70c7b-bd19-42dc-8445-1776f46ce012 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received event network-vif-unplugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-83a686e3-4f49-43f2-9f56-960fe8396862 req-e4b70c7b-bd19-42dc-8445-1776f46ce012 service nova] Acquiring lock "85e83e56-3a30-4c75-b480-b1d298352888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-83a686e3-4f49-43f2-9f56-960fe8396862 req-e4b70c7b-bd19-42dc-8445-1776f46ce012 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-83a686e3-4f49-43f2-9f56-960fe8396862 req-e4b70c7b-bd19-42dc-8445-1776f46ce012 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-83a686e3-4f49-43f2-9f56-960fe8396862 req-e4b70c7b-bd19-42dc-8445-1776f46ce012 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] No waiting events found dispatching network-vif-unplugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG nova.compute.manager [req-83a686e3-4f49-43f2-9f56-960fe8396862 req-e4b70c7b-bd19-42dc-8445-1776f46ce012 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received event network-vif-unplugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:34:53 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Instance destroyed successfully.
Oct 30 11:34:53 user nova-compute[74278]: DEBUG nova.objects.instance [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'resources' on Instance uuid 85e83e56-3a30-4c75-b480-b1d298352888 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:18:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1840118535',display_name='tempest-ServerRescueNegativeTestJSON-server-1840118535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1840118535',id=46,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:20:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a881207e0d4a4314a979e3af56cf2f95',ramdisk_id='',reservation_id='r-oypjijxg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2065673492',owner_user_name='tempest-ServerRescueNegativeTestJSON-2065673492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:20:13Z,user_data=None,user_id='8ad932a451724349a5c40964d7e75157',uuid=85e83e56-3a30-4c75-b480-b1d298352888,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converting VIF {"id": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "address": "fa:16:3e:fc:b3:13", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap360af3bb-6a", "ovs_interfaceid": "360af3bb-6ad9-45f4-8f7f-5864a99a0e35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=360af3bb-6ad9-45f4-8f7f-5864a99a0e35,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360af3bb-6a') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG os_vif [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=360af3bb-6ad9-45f4-8f7f-5864a99a0e35,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360af3bb-6a') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap360af3bb-6a, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfa269ad-b570-4b74-9636-ea272c2a0284) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:53 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:34:54 user nova-compute[74278]: INFO os_vif [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=360af3bb-6ad9-45f4-8f7f-5864a99a0e35,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap360af3bb-6a')
Oct 30 11:34:54 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Deleting instance files /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888_del
Oct 30 11:34:54 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Deletion of /opt/stack/data/nova/instances/85e83e56-3a30-4c75-b480-b1d298352888_del complete
Oct 30 11:34:54 user nova-compute[74278]: INFO nova.compute.manager [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 30 11:34:54 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:34:54 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:34:54 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:34:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:34:54 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:34:54 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Took 0.43 seconds to deallocate network for instance.
Oct 30 11:34:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-ca0d2777-54ad-445d-8938-e68a70f1b5b9 req-68747b52-cb47-40be-87f1-80d3646979c6 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received event network-vif-deleted-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:34:54 user nova-compute[74278]: INFO nova.compute.manager [req-ca0d2777-54ad-445d-8938-e68a70f1b5b9 req-68747b52-cb47-40be-87f1-80d3646979c6 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Neutron deleted interface 360af3bb-6ad9-45f4-8f7f-5864a99a0e35; detaching it from the instance and deleting it from the info cache
Oct 30 11:34:54 user nova-compute[74278]: DEBUG nova.network.neutron [req-ca0d2777-54ad-445d-8938-e68a70f1b5b9 req-68747b52-cb47-40be-87f1-80d3646979c6 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:34:54 user nova-compute[74278]: DEBUG nova.compute.manager [req-ca0d2777-54ad-445d-8938-e68a70f1b5b9 req-68747b52-cb47-40be-87f1-80d3646979c6 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Detach interface failed, port_id=360af3bb-6ad9-45f4-8f7f-5864a99a0e35, reason: Instance 85e83e56-3a30-4c75-b480-b1d298352888 could not be found. {{(pid=74278) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 11:34:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:34:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:34:54 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:34:54 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:34:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:34:54 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Deleted allocations for instance 85e83e56-3a30-4c75-b480-b1d298352888
Oct 30 11:34:54 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-fa29e39f-e856-4459-b22b-968b791157b3 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "85e83e56-3a30-4c75-b480-b1d298352888" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.504s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:34:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-99ed0008-bbb7-48f6-9cf1-43eb23c418e7 req-2d65452c-cc1f-44e8-a49e-61d899f020b6 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received event network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:34:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-99ed0008-bbb7-48f6-9cf1-43eb23c418e7 req-2d65452c-cc1f-44e8-a49e-61d899f020b6 service nova] Acquiring lock "85e83e56-3a30-4c75-b480-b1d298352888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:34:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-99ed0008-bbb7-48f6-9cf1-43eb23c418e7 req-2d65452c-cc1f-44e8-a49e-61d899f020b6 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:34:55 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-99ed0008-bbb7-48f6-9cf1-43eb23c418e7 req-2d65452c-cc1f-44e8-a49e-61d899f020b6 service nova] Lock "85e83e56-3a30-4c75-b480-b1d298352888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:34:55 user nova-compute[74278]: DEBUG nova.compute.manager [req-99ed0008-bbb7-48f6-9cf1-43eb23c418e7 req-2d65452c-cc1f-44e8-a49e-61d899f020b6 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] No waiting events found dispatching network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:34:55 user nova-compute[74278]: WARNING nova.compute.manager [req-99ed0008-bbb7-48f6-9cf1-43eb23c418e7 req-2d65452c-cc1f-44e8-a49e-61d899f020b6 service nova] [instance: 85e83e56-3a30-4c75-b480-b1d298352888] Received unexpected event network-vif-plugged-360af3bb-6ad9-45f4-8f7f-5864a99a0e35 for instance with vm_state deleted and task_state None.
Oct 30 11:34:57 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:34:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:34:58 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:34:59 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:34:59 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:34:59 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:34:59 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:35:01 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:35:03 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:04 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:35:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:35:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 11:35:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 11:35:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquired lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 11:35:04 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Forcefully refreshing network info cache for instance {{(pid=74278) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 11:35:04 user nova-compute[74278]: DEBUG nova.objects.instance [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lazy-loading 'info_cache' on Instance uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:35:04 user nova-compute[74278]: DEBUG nova.network.neutron [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updating instance_info_cache with network_info: [{"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:35:04 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Releasing lock "refresh_cache-8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" {{(pid=74278) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 11:35:04 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updated the network info_cache for instance {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 11:35:05 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:35:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:35:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:35:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:35:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:35:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:35:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:35:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 11:35:05 user nova-compute[74278]: DEBUG oslo_concurrency.processutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74278) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 11:35:06 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:35:06 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:35:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=8914MB free_disk=24.840499877929688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:35:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:35:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:35:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74278) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 11:35:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:35:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:35:06 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:35:06 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:35:06 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:35:06 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:35:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:35:18 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:35:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:35:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:35:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:35:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:35:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:35:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:35:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:35:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:35:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:35:44 user nova-compute[74278]: INFO nova.compute.manager [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Terminating instance
Oct 30 11:35:44 user nova-compute[74278]: DEBUG nova.compute.manager [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Start destroying the instance on the hypervisor. {{(pid=74278) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc6e0b1f-acc0-4c37-b4f9-52dca44b3968 req-9b3798f1-9f43-4809-a097-7b681712740f service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-unplugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc6e0b1f-acc0-4c37-b4f9-52dca44b3968 req-9b3798f1-9f43-4809-a097-7b681712740f service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc6e0b1f-acc0-4c37-b4f9-52dca44b3968 req-9b3798f1-9f43-4809-a097-7b681712740f service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-bc6e0b1f-acc0-4c37-b4f9-52dca44b3968 req-9b3798f1-9f43-4809-a097-7b681712740f service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc6e0b1f-acc0-4c37-b4f9-52dca44b3968 req-9b3798f1-9f43-4809-a097-7b681712740f service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-unplugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG nova.compute.manager [req-bc6e0b1f-acc0-4c37-b4f9-52dca44b3968 req-9b3798f1-9f43-4809-a097-7b681712740f service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-unplugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with task_state deleting. {{(pid=74278) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:44 user nova-compute[74278]: INFO nova.virt.libvirt.driver [-] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Instance destroyed successfully.
Oct 30 11:35:44 user nova-compute[74278]: DEBUG nova.objects.instance [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lazy-loading 'resources' on Instance uuid 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9 {{(pid=74278) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG nova.virt.libvirt.vif [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T11:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1317166121',display_name='tempest-ServerRescueNegativeTestJSON-server-1317166121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1317166121',id=45,image_ref='4107584d-f654-453b-972a-abcf1c7a0671',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T11:23:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a881207e0d4a4314a979e3af56cf2f95',ramdisk_id='',reservation_id='r-si04jmc2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4107584d-f654-453b-972a-abcf1c7a0671',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2065673492',owner_user_name='tempest-ServerRescueNegativeTestJSON-2065673492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T11:24:59Z,user_data=None,user_id='8ad932a451724349a5c40964d7e75157',uuid=8cafd05d-e81c-4f9d-975d-f18bd37f8eb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converting VIF {"id": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "address": "fa:16:3e:81:a3:4a", "network": {"id": "323da8b7-e953-401e-8999-030f3d5b1a0f", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981713578-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a881207e0d4a4314a979e3af56cf2f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e58a9e9-0f", "ovs_interfaceid": "5e58a9e9-0fbe-41b9-9795-0de8d50150b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG nova.network.os_vif_util [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:a3:4a,bridge_name='br-int',has_traffic_filtering=True,id=5e58a9e9-0fbe-41b9-9795-0de8d50150b3,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e58a9e9-0f') {{(pid=74278) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG os_vif [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:a3:4a,bridge_name='br-int',has_traffic_filtering=True,id=5e58a9e9-0fbe-41b9-9795-0de8d50150b3,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e58a9e9-0f') {{(pid=74278) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e58a9e9-0f, bridge=br-int, if_exists=True) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=488b157d-dd1c-473a-8ec5-adcea3979699) {{(pid=74278) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:35:44 user nova-compute[74278]: INFO os_vif [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:a3:4a,bridge_name='br-int',has_traffic_filtering=True,id=5e58a9e9-0fbe-41b9-9795-0de8d50150b3,network=Network(323da8b7-e953-401e-8999-030f3d5b1a0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e58a9e9-0f')
Oct 30 11:35:44 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Deleting instance files /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9_del
Oct 30 11:35:44 user nova-compute[74278]: INFO nova.virt.libvirt.driver [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Deletion of /opt/stack/data/nova/instances/8cafd05d-e81c-4f9d-975d-f18bd37f8eb9_del complete
Oct 30 11:35:45 user nova-compute[74278]: INFO nova.compute.manager [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 30 11:35:45 user nova-compute[74278]: DEBUG oslo.service.loopingcall [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74278) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 11:35:45 user nova-compute[74278]: DEBUG nova.compute.manager [-] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Deallocating network for instance {{(pid=74278) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 11:35:45 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] deallocate_for_instance() {{(pid=74278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 11:35:45 user nova-compute[74278]: DEBUG nova.network.neutron [-] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Updating instance_info_cache with network_info: [] {{(pid=74278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 11:35:45 user nova-compute[74278]: INFO nova.compute.manager [-] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Took 0.37 seconds to deallocate network for instance.
Oct 30 11:35:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:35:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:35:45 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:35:45 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:35:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:35:45 user nova-compute[74278]: INFO nova.scheduler.client.report [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Deleted allocations for instance 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9
Oct 30 11:35:45 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-ed3daee9-a107-497c-a642-ca4698455b23 tempest-ServerRescueNegativeTestJSON-2065673492 tempest-ServerRescueNegativeTestJSON-2065673492-project-member] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.720s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:35:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-89f87080-87ab-4bc5-a151-dc69084c949f req-2be94030-c44a-4d40-9f33-59755988a00e service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:35:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-89f87080-87ab-4bc5-a151-dc69084c949f req-2be94030-c44a-4d40-9f33-59755988a00e service nova] Acquiring lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:35:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-89f87080-87ab-4bc5-a151-dc69084c949f req-2be94030-c44a-4d40-9f33-59755988a00e service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:35:46 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [req-89f87080-87ab-4bc5-a151-dc69084c949f req-2be94030-c44a-4d40-9f33-59755988a00e service nova] Lock "8cafd05d-e81c-4f9d-975d-f18bd37f8eb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:35:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-89f87080-87ab-4bc5-a151-dc69084c949f req-2be94030-c44a-4d40-9f33-59755988a00e service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] No waiting events found dispatching network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 11:35:46 user nova-compute[74278]: WARNING nova.compute.manager [req-89f87080-87ab-4bc5-a151-dc69084c949f req-2be94030-c44a-4d40-9f33-59755988a00e service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received unexpected event network-vif-plugged-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 for instance with vm_state deleted and task_state None.
Oct 30 11:35:46 user nova-compute[74278]: DEBUG nova.compute.manager [req-89f87080-87ab-4bc5-a151-dc69084c949f req-2be94030-c44a-4d40-9f33-59755988a00e service nova] [instance: 8cafd05d-e81c-4f9d-975d-f18bd37f8eb9] Received event network-vif-deleted-5e58a9e9-0fbe-41b9-9795-0de8d50150b3 {{(pid=74278) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 11:35:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:53 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:35:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:35:57 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:35:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:35:59 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:35:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:36:01 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:36:01 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:36:01 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:36:01 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:36:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:36:05 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:36:05 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:36:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=9095MB free_disk=24.867694854736328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:36:05 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:36:06 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:36:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:36:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 11:36:06 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Didn't find any instances for network info cache update. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 11:36:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:36:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:36:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:36:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:36:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:36:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:36:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:36:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:36:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:36:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:36:34 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:36:36 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:36:37 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:36:39 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:36:44 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:36:46 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:36:49 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:36:54 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:36:54 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:36:57 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:36:57 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74278) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 11:36:59 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:37:01 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:37:02 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:37:02 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:37:02 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:37:03 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:37:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:37:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:37:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:37:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:37:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:37:04 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:37:07 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager.update_available_resource {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:37:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:37:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:37:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:37:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Auditing locally available compute resources for user (node: user) {{(pid=74278) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 11:37:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:37:07 user nova-compute[74278]: WARNING nova.virt.libvirt.driver [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 11:37:07 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Hypervisor/Node resource view: name=user free_ram=9089MB free_disk=24.865753173828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74278) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 11:37:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 11:37:07 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 11:37:08 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 11:37:08 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74278) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 11:37:08 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing inventories for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 11:37:08 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating ProviderTree inventory for provider ce405684-67ab-45d9-bc83-6af4903bfb15 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 11:37:08 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Updating inventory in ProviderTree for provider ce405684-67ab-45d9-bc83-6af4903bfb15 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 11:37:08 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing aggregate associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, aggregates: None {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 11:37:08 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Refreshing trait associations for resource provider ce405684-67ab-45d9-bc83-6af4903bfb15, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_RESCUE_BFV,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=74278) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 11:37:08 user nova-compute[74278]: DEBUG nova.compute.provider_tree [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed in ProviderTree for provider: ce405684-67ab-45d9-bc83-6af4903bfb15 {{(pid=74278) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 11:37:08 user nova-compute[74278]: DEBUG nova.scheduler.client.report [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Inventory has not changed for provider ce405684-67ab-45d9-bc83-6af4903bfb15 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74278) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 11:37:08 user nova-compute[74278]: DEBUG nova.compute.resource_tracker [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Compute_service record updated for user:user {{(pid=74278) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 11:37:08 user nova-compute[74278]: DEBUG oslo_concurrency.lockutils [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=74278) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 11:37:09 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:37:09 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Starting heal instance info cache {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 11:37:09 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Rebuilding the list of instances to heal {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 11:37:09 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Didn't find any instances for network info cache update. {{(pid=74278) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 11:37:09 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:37:14 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:37:19 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:37:20 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:37:23 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:37:23 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances with incomplete migration  {{(pid=74278) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 11:37:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:37:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:37:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74278) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 11:37:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:37:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74278) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 11:37:24 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 11:37:29 user nova-compute[74278]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74278) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 11:37:30 user nova-compute[74278]: DEBUG oslo_service.periodic_task [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74278) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 11:37:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] Cleaning up deleted instances {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 11:37:30 user nova-compute[74278]: DEBUG nova.compute.manager [None req-72d28414-4387-4e85-b9ad-6bf03775904f None None] There are 0 instances to clean {{(pid=74278) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}